-- Logs begin at Tue 2022-04-12 13:54:47 UTC, end at Tue 2022-04-12 15:39:07 UTC. -- Apr 12 14:44:31.319888 dv-cinder-837524-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 12 14:44:31.327266 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 14:44:31.329242 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 12 14:44:31 2022] *** Apr 12 14:44:31.329242 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 12 14:44:31.329242 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 12 14:44:31.329242 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: nodename: dv-cinder-837524-1-iscsi Apr 12 14:44:31.329242 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: machine: x86_64 Apr 12 14:44:31.329242 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: clock source: unix Apr 12 14:44:31.329701 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: pcre jit disabled Apr 12 14:44:31.329701 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: detected number of CPU cores: 4 Apr 12 14:44:31.329701 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: current working directory: / Apr 12 14:44:31.329701 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: detected binary path: /usr/bin/uwsgi-core Apr 12 14:44:31.329701 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: your processes number limit is 47680 Apr 12 14:44:31.329701 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: your memory page size is 4096 bytes Apr 12 14:44:31.329701 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: detected max file descriptor number: 2048 Apr 12 14:44:31.329701 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: lock engine: pthread robust mutexes Apr 12 14:44:31.329701 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: thunder lock: enabled Apr 12 14:44:31.329701 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 14:44:31.332682 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 12 14:44:31.376076 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: Python main interpreter initialized at 0x560b7acc39c0 Apr 12 14:44:31.376076 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: python threads support enabled Apr 12 14:44:31.376076 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: your server socket listen backlog is limited to 100 connections Apr 12 14:44:31.376076 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: your mercy for graceful operations on workers is 90 seconds Apr 12 14:44:31.376440 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: mapped 403077 bytes (393 KB) for 2 cores Apr 12 14:44:31.376526 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: *** Operational MODE: preforking *** Apr 12 14:44:31.376785 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: *** uWSGI is running in multiple interpreter mode *** Apr 12 14:44:31.376785 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: spawned uWSGI master process (pid: 109785) Apr 12 14:44:31.376998 dv-cinder-837524-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 12 14:44:31.377573 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: spawned uWSGI worker 1 (pid: 109786, cores: 1) Apr 12 14:44:31.377963 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: spawned uWSGI worker 2 (pid: 109787, cores: 1) Apr 12 14:44:31.378131 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 14:44:32.579818 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 14:44:32.583472 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 14:44:33.437602 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:44:33.437602 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: from cryptography.utils import int_from_bytes Apr 12 14:44:33.437970 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:44:33.437970 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: from cryptography.utils import int_from_bytes Apr 12 14:44:33.438443 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:44:33.438443 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: from cryptography.utils import int_from_bytes Apr 12 14:44:33.438777 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:44:33.438777 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: from cryptography.utils import int_from_bytes Apr 12 14:44:35.981396 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 14:44:35.981972 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 14:44:35.982118 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 14:44:35.982482 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 14:44:35.982737 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 14:44:35.983128 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.983456 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.983781 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.984104 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.984436 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.984750 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.985073 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.985394 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.985747 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.986010 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.986388 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.986809 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837524-1-iscsi {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.987137 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 14:44:35.987514 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.987596 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 14:44:35.987682 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.987762 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.987911 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 14:44:35.988053 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.988273 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 14:44:35.988361 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.988527 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 14:44:35.988668 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.988912 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.988997 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.989238 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.989468 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.989580 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.990660 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.990809 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.990925 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991021 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991146 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991237 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991330 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991416 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991506 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991591 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991677 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991769 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991848 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.991938 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.992017 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.992142 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.992266 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837524-1-iscsi {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.992390 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.992582 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.992703 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.992883 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.993105 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837524-1-iscsi {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.993192 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.993428 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.993514 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.993771 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.993872 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.994090 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.994185 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.994402 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.994492 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.994803 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.994946 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.995116 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.995203 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.995440 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.995569 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.995767 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.995907 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.996082 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.996181 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.996418 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.996514 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.996712 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.996813 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.997028 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.997129 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.997332 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.997419 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.997653 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.997754 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.997968 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.998057 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.998279 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.998371 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837524-1-iscsi {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.998599 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.998687 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.998903 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.998991 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.999210 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.999315 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.999459 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.999635 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.999774 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:35.999947 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.000098 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.000247 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.000423 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.000566 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.000742 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.000886 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.000994 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.001206 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.001306 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.001513 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.001601 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.001920 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.002229 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.002401 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.002540 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.002733 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.002850 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.003056 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.003150 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.003360 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.003457 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.003671 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.003766 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.003980 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.004074 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.004297 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.004397 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.004601 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.004687 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.004902 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.004996 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.005157 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.005258 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.005464 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.005552 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.005814 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.005917 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.006134 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.006246 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.006452 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.006544 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.006702 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.006792 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.006950 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.007112 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.007267 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.007430 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.007584 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.007740 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.007891 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.008056 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.008197 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.008378 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.008501 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.008686 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.008807 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.008993 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.009110 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.009304 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.009399 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.009638 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.009729 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.009979 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.010067 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.010285 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.010381 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.010532 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.010653 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.010831 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.010926 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.011136 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.011223 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.011453 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.011548 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.011759 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.011891 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.012064 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.012167 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.012370 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.012464 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.012668 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.012757 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.012973 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.013070 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.013278 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.013364 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.013582 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.013693 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.013912 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.014013 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.014218 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.014315 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.014520 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.014637 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.014827 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.014928 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.015134 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.015221 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.015437 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.015532 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.015752 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.015911 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.015996 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.016128 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.016280 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.016371 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.016584 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.016681 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.016896 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.016983 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.017198 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.017293 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.018172 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.018487 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.018581 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.018796 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.018885 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.019118 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.019218 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.019425 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.019517 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.019733 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.019821 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.020045 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.020205 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.020352 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.020438 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.020657 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.020766 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.020959 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.021063 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.021257 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.021351 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.021556 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.021684 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.021884 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.021989 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.022192 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.022285 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.022498 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.022586 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.022801 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.022888 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.023105 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.023196 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.023405 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.023500 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.023709 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.023795 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.024012 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.024099 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.024314 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.024399 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.024610 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.024696 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.024924 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.025018 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.025227 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.025314 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.025534 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.025647 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.025861 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.025947 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.026161 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.026247 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.026466 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.026554 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.026779 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.026866 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.027075 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.027164 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.027380 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.027468 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.027690 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.027777 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.027992 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.028089 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.028293 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.028387 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.028592 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.028692 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.028892 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.028989 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.029191 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.029279 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.029490 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.029600 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.029815 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.029920 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.030114 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.030242 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.030407 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.030555 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.030744 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.030876 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.031032 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.031194 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.031337 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.031523 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.031640 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.031839 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.031947 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.032155 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.032262 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:44:36.032471 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.032593 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.032783 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.032919 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.033677 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.033987 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.034310 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.034410 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.034622 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.034710 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.034965 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.035074 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.035295 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.035400 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.035608 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.035696 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.035922 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.036009 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.036237 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.036334 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.036550 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.036638 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.036859 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.036952 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.037168 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.037257 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.037476 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.037571 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.037831 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.037922 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.038150 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.038240 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.038466 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.038552 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.038778 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.038865 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.039088 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.039175 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.039399 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.039495 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.039705 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.039798 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.040018 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.040111 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.040336 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.040422 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.040653 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.040861 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.040961 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.041042 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.041270 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.041363 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.041586 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.041723 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.041923 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.042010 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.042233 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.042318 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.042545 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.042717 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.042851 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.042945 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.043154 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.043242 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.043457 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.043553 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.043768 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.043856 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.044073 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.044160 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.044392 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.044487 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.044708 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.044796 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.045011 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.045097 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.045318 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.045405 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.045651 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.045742 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.045961 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.046050 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.046268 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.046356 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.046577 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.046673 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.046881 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.046980 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.047195 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.047283 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.047502 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.047588 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.047803 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.047895 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.048111 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.048199 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.048420 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.048508 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.048748 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.049070 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.049243 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.049376 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.049560 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.049692 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.049895 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.049997 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.050201 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.050290 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.050511 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.050599 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.050814 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.050928 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.051137 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.051239 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.051458 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.051546 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.051762 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.051863 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.052091 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.052180 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.052395 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.052489 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.052702 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.052797 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.053010 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.053103 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.053319 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.053415 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.053621 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.053730 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.053952 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.054039 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.054260 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.054349 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.054560 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.054674 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.054865 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.054952 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.055171 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.055258 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.055472 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.055560 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.055779 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.055869 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.056081 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.056179 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.056378 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.056472 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.056680 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.056776 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.056982 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.057079 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.057283 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.057370 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.057591 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.057728 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.057922 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.058018 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.058226 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.058321 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.058529 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.058623 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.058832 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.058929 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.059159 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.059244 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.059463 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.059556 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.059774 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.059867 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.060092 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.060180 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.060412 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.060499 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.060722 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.060811 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.061021 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.061123 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.061328 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.061428 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.061646 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.061736 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.061952 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.062052 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.062253 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.062341 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.062557 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.062654 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.062856 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.062943 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.063157 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.063254 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.063458 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.063546 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.063756 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.063845 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.064057 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.064158 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.064395 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.064724 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.064839 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.065125 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.065213 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.065446 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.065535 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.065772 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.065864 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.066076 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.066165 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.066420 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.066510 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.066724 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.066823 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.067058 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.067213 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.067372 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.067459 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.067682 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.067769 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.067995 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.068095 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.068307 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.068418 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.068617 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.068711 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.068924 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.069027 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.069234 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.069332 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.069541 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.069667 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.069878 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.070053 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.070197 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.070335 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.070477 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.070611 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.070794 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.070941 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.071093 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.071230 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.071390 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.071521 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.071730 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.071872 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.072006 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.072142 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.072279 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.072421 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.072587 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.072734 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.072921 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.073071 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.073229 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.073372 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.073538 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.073706 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.073875 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.074022 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.074182 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.074318 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.074485 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.074621 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.074790 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.074927 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.075099 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.075248 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.075388 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.075521 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.075702 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.075839 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.076008 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.076109 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.076314 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.076401 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.076618 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.076749 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.076921 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.077023 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.077226 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.077314 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.077529 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.077623 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.077869 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.077973 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.078170 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.078265 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.078479 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.078568 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.078802 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.078922 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.079107 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.079212 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.079411 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.079509 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.079718 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.079821 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.080571 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.080853 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.081010 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.081322 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.081475 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.081652 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.081817 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.081996 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.082132 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.082304 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.082439 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.082600 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.082744 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.082919 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.083055 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.083241 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.083369 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.083552 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.083677 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.083866 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.083985 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.084176 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.084272 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.084486 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.084575 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.084808 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.084896 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.085125 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.085213 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.085436 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.085530 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.085770 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.085862 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.086086 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.086175 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.086397 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.086493 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.086707 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.086835 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.087022 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.087109 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.087325 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.087414 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.087626 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.087723 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.087936 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.088023 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.088239 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.088326 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.088539 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.088641 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.088841 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.088929 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.089142 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.089409 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.089497 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.089772 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.089865 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.090084 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.090172 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.090395 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.090484 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.090711 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.090813 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.091017 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.091115 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.091326 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.091422 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.091633 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.091734 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.091936 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.092024 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.092248 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.092349 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.092559 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.092647 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.092865 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.092952 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.093173 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.093269 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.093479 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.093575 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.093810 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.093898 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.094115 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.094201 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.094420 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.094509 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.094725 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.094811 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.095028 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.095123 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.095330 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.095418 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.096182 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.096507 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.096691 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.096811 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.097014 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.097113 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.097333 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.097422 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.097736 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.098057 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.098161 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.098366 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.098460 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.098672 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.098760 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.098977 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.099065 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.099282 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.099377 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.099607 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.099694 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.099918 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.100006 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.100504 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.100606 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.100832 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.100935 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.101140 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.101240 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.101449 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.101538 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.101778 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.101879 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.102082 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.102189 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.102393 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.102491 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.102696 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.102790 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.102997 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.103084 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.103297 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.103392 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.103604 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.103693 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.103903 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.103991 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.104204 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.104300 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.104506 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.104595 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.104807 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.104903 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.105114 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.105207 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.105413 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.105507 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.105743 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.105835 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.106045 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.106144 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.106358 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.106457 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.106663 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.106749 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.106962 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.107105 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.107262 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.107360 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.107561 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.107656 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.107869 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.107956 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.108173 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.108273 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.108483 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.108578 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.108786 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.108880 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.109102 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.109198 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.109407 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.109495 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.109732 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.109833 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.110037 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.110133 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.110341 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.110427 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.110643 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.110731 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.110944 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.111086 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.111386 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.111711 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.111890 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.112025 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.112176 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.112313 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.112447 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.112614 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.112759 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.112921 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.113079 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.113216 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.113352 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.113525 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.113683 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.113882 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.114015 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.114198 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.114336 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.114503 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.114640 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.114813 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.114950 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.115118 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.115255 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.115419 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.115563 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.115712 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.115850 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.116011 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.116144 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.116301 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.116388 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.116601 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.116743 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.116904 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.117047 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.117202 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.117302 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.117503 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.117589 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.117828 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.117917 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.118128 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.118226 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.118429 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.118517 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.118732 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.118819 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.119035 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.119130 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.119378 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.119466 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.119683 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.119808 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.120039 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.120134 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.120347 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.120436 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.120648 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.120736 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.120955 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.121043 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.121255 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.121346 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.121555 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.121663 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.121887 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.121977 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.122189 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.122276 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.122503 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.122590 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.122804 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.122892 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.123109 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.123197 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.123410 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.123498 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.123708 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.123797 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.124009 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.124097 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.124312 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.124413 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.124610 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.124706 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.124909 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.124997 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.125206 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.125303 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.125503 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.125592 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.125823 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.125912 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.126141 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.126243 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.126450 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.126583 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.127256 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.127393 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.127574 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.128025 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.128114 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.128344 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.128433 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.128658 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.128758 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.128972 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.129068 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.129285 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.129374 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.129599 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.129762 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.129938 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.130056 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.130243 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.130340 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.130551 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.130650 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.130859 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.130969 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.131169 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.131268 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.131469 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.131664 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.131772 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.131852 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.132068 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.132168 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.132371 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.132460 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.132669 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.132757 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.132970 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.133057 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.133303 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.133399 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.133595 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.135493 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.135591 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.135673 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.135762 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.135844 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.135924 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.136003 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.136082 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.136162 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.136419 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.136521 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.136628 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.136698 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.136772 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.136850 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.136934 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137002 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137068 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137134 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137206 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137285 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137374 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137445 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137512 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137590 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137675 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137757 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.137826 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.138088 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.138200 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.138384 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.138481 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.138687 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.138784 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.138990 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.139086 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.139290 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.139398 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.139607 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.139703 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.139908 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.140003 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.140203 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.140307 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.140510 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.140607 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.140809 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.140934 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.141114 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.141227 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.141415 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.141675 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.141857 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.141992 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.142167 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.142427 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.142623 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.142765 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.143104 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.143337 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.143487 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.143645 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.143734 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.143950 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.144040 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.144264 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.144362 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.144581 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.144670 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.144883 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.144973 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.145224 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.145323 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.145538 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.145648 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.145866 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.145955 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.146187 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.146293 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.146508 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.146597 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.146817 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.146918 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.147128 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.147219 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.147464 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.147611 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.147748 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.147838 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.148079 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.148192 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.148381 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.148472 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.148721 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.148817 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.149024 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.149113 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.149332 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.149427 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.149677 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.149785 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.149967 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.150056 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.150271 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.150360 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.150589 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.150739 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.150898 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.151050 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.151209 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.151356 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.151519 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.151672 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.151826 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.151987 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.152128 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.152303 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.152430 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.152602 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.152748 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.152914 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.153051 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.153219 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.153371 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.153538 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.153706 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.153883 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.154027 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.154192 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.154347 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.154502 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.154650 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.154804 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.154968 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.155121 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.155276 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.155438 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.155581 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.155750 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.155886 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.156066 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.156188 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.156470 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.156568 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.156792 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.156940 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.157101 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.157191 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.157417 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.157515 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.157757 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.157862 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.158612 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.158768 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.158950 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.159208 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.159303 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.159448 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.159576 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.159754 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.159897 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.160059 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.160221 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.160379 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.160527 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.160680 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.160818 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.160990 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.161132 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.161298 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.161445 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.161604 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.161771 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.161928 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.162065 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.162229 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.162375 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.162546 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.162679 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.162847 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.162983 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.163162 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.163286 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.163472 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.163605 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.163789 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.163915 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.164105 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.164217 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.164405 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.164528 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.164721 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.164817 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.165026 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.165128 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.165326 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.165422 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.165661 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.165767 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.165950 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.166082 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.166290 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.166381 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.166592 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.166682 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.166910 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.167055 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.167240 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.167330 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.167564 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.167667 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.167870 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.168034 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.168201 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.168290 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.168520 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.168609 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.168831 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.168929 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.169145 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.169234 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.169459 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.169547 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.169781 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.169884 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.170083 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.170186 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.170392 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.170481 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.170696 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.170793 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.170998 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.171086 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.171299 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.171388 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.171603 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.171836 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.171938 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.172165 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.172255 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.172472 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.172572 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.172785 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.172881 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.173083 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.173172 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.173400 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.173507 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.174354 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.174641 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.174733 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.174955 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.175063 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.175269 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.175358 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.175582 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.175672 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.175912 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.176080 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.176234 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.176326 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.176558 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.176648 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.176871 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.176973 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.177190 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.177278 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.177506 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.177596 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.177847 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.177980 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.178161 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.178250 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.178476 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.178564 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.178812 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.178909 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.179109 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.179213 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.179419 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.179566 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.179731 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.179822 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.180043 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.180137 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.180353 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.180449 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.180661 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.180750 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.180973 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.181072 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.181284 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.181438 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.181598 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.181773 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.181933 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.182141 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.182232 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.182468 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.182566 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.182781 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.182924 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.183091 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.183265 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.183408 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.183546 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.183682 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.183826 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.183996 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.184148 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.184291 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.184443 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.184581 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.184880 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.185020 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.185175 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.185323 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.185496 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.185655 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.185843 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.185985 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.186164 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.186301 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.186483 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.186624 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.186791 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.186971 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.187103 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.187251 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.187394 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.187533 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.187692 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.187840 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.188003 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.188138 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.188312 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.188446 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.188616 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.188752 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.188934 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.189077 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.189264 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.189463 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.189617 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.189899 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.190133 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.190273 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.190456 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.190726 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.190874 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.191070 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.191209 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.191367 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.191504 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.191677 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.191836 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.191981 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.192127 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.192269 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.192405 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.192582 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.192719 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.192906 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.193045 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.193209 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.193355 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.193500 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.193666 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.193836 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.193985 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.194131 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.194276 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.194420 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.194565 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.194700 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.194973 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.195120 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.195279 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.195417 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.195593 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.195739 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.195901 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.196040 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.196191 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.196327 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.196512 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.196659 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.196817 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.196912 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.197120 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.197216 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.197421 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.197561 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.197730 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.197866 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.198037 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.198199 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.198344 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.198486 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.198624 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.198768 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.198910 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.199046 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.199195 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.199330 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.199495 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.199643 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.199802 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.199947 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.200104 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.200244 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.200414 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.200629 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.200768 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.200972 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.201111 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.201288 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.201436 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.201612 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.201773 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.201958 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.202092 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.202273 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.202421 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.202560 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.202698 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.202881 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.203025 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.203169 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.203310 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.203455 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.203606 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.203751 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.203890 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.204061 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.204207 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.204347 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.204486 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.204645 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.204975 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.205120 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.205395 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.205750 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.205897 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.206088 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.206227 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.206418 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.206569 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.206726 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.206863 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.207033 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.207178 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.207323 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.207459 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.207639 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.207776 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.207945 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.208084 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.208253 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.208388 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.208555 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.208692 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.208858 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.209004 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.209148 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.209283 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.209451 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.209599 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.209783 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.209930 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.210068 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.210204 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.210378 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.210517 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.210680 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.210828 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.210987 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.211124 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.211286 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.211442 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.211583 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.211730 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.211927 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.212082 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.212244 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.212383 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.212529 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.212666 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.212832 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.212922 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.213148 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.213283 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.213447 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.213587 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.213773 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.213911 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.214070 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.214210 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.214370 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.214516 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.214683 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.214822 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.215012 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.215164 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.215318 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.215538 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.215679 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.215868 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.216024 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.216189 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.216328 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.216519 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.216659 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.216850 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.216989 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.217159 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.217299 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.217597 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.217871 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.218032 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.218166 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.218344 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.218491 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.218668 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.218808 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.218981 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.219128 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.219295 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.219441 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.219588 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.219731 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.219901 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.220050 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.220210 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.220349 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.221148 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.221456 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.221604 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.221794 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.221932 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.222100 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.222245 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.222407 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.222559 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.222695 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.222842 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.222997 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.223131 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.223307 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.223454 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.223611 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.223750 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.223914 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.224053 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.224202 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.224347 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.224504 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.224649 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.224813 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.224952 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.225359 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.225509 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.225675 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.225817 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.225983 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.226122 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.226287 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.226437 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.226573 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.226713 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.226876 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.227016 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.227181 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.227320 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.227496 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.227661 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.227796 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.227897 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.228089 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.228262 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.228395 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.228575 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.228696 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.228895 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.229026 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.229217 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.229355 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.229528 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.229690 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.229874 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.230014 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.230195 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.230326 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.230507 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.230648 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.230827 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.230959 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.231138 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.231279 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.231506 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.231604 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.231798 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.231910 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.232123 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.232253 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.232445 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.232544 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.232747 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.232837 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.233048 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.233175 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.233349 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.233448 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.233673 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.233769 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.233991 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.234080 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.234297 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.234399 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.234598 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.234687 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.234897 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.234986 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.235202 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.235294 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.235504 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.235592 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.235804 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.235894 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.236124 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.236792 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.237237 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.237508 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.237599 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.237858 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.237962 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.238175 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.238265 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.238486 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.238576 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.238791 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.238944 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.239099 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.239195 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.239404 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.239498 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.239710 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.239807 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.240020 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.240109 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.240325 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.240422 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.240628 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.240718 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.240928 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.241025 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.241232 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.241329 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.241536 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.241685 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.241893 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.241984 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.242225 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.242362 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.242541 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.242630 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.242862 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.242950 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.243175 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.243316 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.243485 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.243581 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.243727 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 14:44:36.243816 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.244098 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.244418 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.244730 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.245039 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.245368 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.245697 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.246012 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.246324 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.246632 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.246939 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.247247 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.247571 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.247899 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.248204 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.248526 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.248841 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.249157 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.249471 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.249803 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.250131 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.250444 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.250750 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.251063 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.251374 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.251683 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.252552 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.252879 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.253210 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.253539 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.253892 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.254220 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.254567 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.254882 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.255226 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.255553 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.255866 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.256179 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.256483 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:44:36.256726 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 14:44:36.266222 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:44:36.279179 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_db.sqlalchemy.engines [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:44:36.328946 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.context [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),801f6a72-d6ac-4cbe-9661-63bd44124606(cell1) {{(pid=109786) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 14:44:36.334749 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG oslo_concurrency.lockutils [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:44:36.336352 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG oslo_concurrency.lockutils [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:44:36.337165 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG oslo_concurrency.lockutils [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:44:36.339126 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG oslo_concurrency.lockutils [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:44:36.343119 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.context [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),801f6a72-d6ac-4cbe-9661-63bd44124606(cell1) {{(pid=109787) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 14:44:36.350349 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:44:36.350750 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:44:36.351919 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:44:36.352031 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:44:36.352824 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:44:36.354862 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:44:36.368448 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_db.sqlalchemy.engines [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:44:36.371138 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_db.sqlalchemy.engines [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:44:36.517956 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:44:36.537502 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_db.sqlalchemy.engines [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:44:37.082203 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: WARNING keystonemiddleware.auth_token [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 14:44:37.088986 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: WARNING keystonemiddleware.auth_token [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 14:44:37.105458 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: WARNING keystonemiddleware.auth_token [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 14:44:37.112713 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: WARNING keystonemiddleware.auth_token [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 14:44:37.324983 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: WARNING keystonemiddleware.auth_token [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 14:44:37.331448 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: WARNING keystonemiddleware.auth_token [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 14:44:37.336678 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560b7acc39c0 pid: 109786 (default app) Apr 12 14:44:37.337328 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: WARNING keystonemiddleware.auth_token [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 14:44:37.338704 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:44:37.339864 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001717 Apr 12 14:44:37.340259 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Tue Apr 12 14:44:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:44:37.342671 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: WARNING keystonemiddleware.auth_token [None req-838c7065-76df-4740-8eab-b89e1d33b58b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 14:44:37.348769 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560b7acc39c0 pid: 109787 (default app) Apr 12 14:46:02.702587 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:02.706323 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003055 Apr 12 14:46:02.706323 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:03.146421 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-0a199296-25c7-4d88-8860-dc8121751052 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:03.184346 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-0a199296-25c7-4d88-8860-dc8121751052 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.470645 Apr 12 14:46:03.185668 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Tue Apr 12 14:46:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:46:05.600455 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:05.602091 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-5cf635cc-ea3b-4e06-9ac5-f038f70984db None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Apr 12 14:46:05.602485 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:05.663234 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-34bc2d16-a496-4b10-82ce-6b14baa35eee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "vcpus": 1, "ram": 256, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:05.684172 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:46:05.684172 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: warnings.warn(msg) Apr 12 14:46:05.801432 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-34bc2d16-a496-4b10-82ce-6b14baa35eee admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.192999 Apr 12 14:46:05.806278 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Apr 12 14:46:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:46:06.050051 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-5c007371-d6dd-465c-ac0f-d69f9ab03e64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:06.052608 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:46:06.052608 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: warnings.warn(msg) Apr 12 14:46:06.169911 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-5c007371-d6dd-465c-ac0f-d69f9ab03e64 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359205 Apr 12 14:46:06.170612 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Tue Apr 12 14:46:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:46:08.989245 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-34bc2d16-a496-4b10-82ce-6b14baa35eee admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:08.990878 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-34bc2d16-a496-4b10-82ce-6b14baa35eee admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002259 Apr 12 14:46:08.991623 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:46:09.132653 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-e8c79ca1-5901-4213-9910-a5131ae8cb4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:09.160579 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:46:09.160579 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: warnings.warn(msg) Apr 12 14:46:09.302404 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-e8c79ca1-5901-4213-9910-a5131ae8cb4c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.300961 Apr 12 14:46:09.303225 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Apr 12 14:46:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 14:46:09.317388 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-fde9e849-0336-4013-856a-848964902288 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:09.319435 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:46:09.319435 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: warnings.warn(msg) Apr 12 14:46:09.430097 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-fde9e849-0336-4013-856a-848964902288 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116734 Apr 12 14:46:09.430897 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Tue Apr 12 14:46:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:46:12.050945 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-e8c79ca1-5901-4213-9910-a5131ae8cb4c admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:12.051973 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-e8c79ca1-5901-4213-9910-a5131ae8cb4c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Apr 12 14:46:12.052423 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:12.125849 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-fcb23be3-ad93-4539-b7e1-e1ee7aea558a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "ram": 1024, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:12.248687 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-fcb23be3-ad93-4539-b7e1-e1ee7aea558a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.188670 Apr 12 14:46:12.249860 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Apr 12 14:46:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:46:12.262683 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-73715782-4aa4-4c86-81dd-de3ca70a6793 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:12.394932 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-73715782-4aa4-4c86-81dd-de3ca70a6793 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136423 Apr 12 14:46:12.409661 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Tue Apr 12 14:46:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:46:14.824570 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-fcb23be3-ad93-4539-b7e1-e1ee7aea558a admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:14.825704 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-fcb23be3-ad93-4539-b7e1-e1ee7aea558a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Apr 12 14:46:14.826563 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:14.888773 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-d2889df0-6e2b-4fbe-93b1-de7c543efab1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "ram": 2048, "swap": 0}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:15.007033 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-d2889df0-6e2b-4fbe-93b1-de7c543efab1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.173974 Apr 12 14:46:15.007568 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Apr 12 14:46:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 14:46:15.019812 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-70c20f71-8800-4891-af9b-1b9f6d729f6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:15.155473 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-70c20f71-8800-4891-af9b-1b9f6d729f6e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138659 Apr 12 14:46:15.156433 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Tue Apr 12 14:46:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:46:17.582275 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-d2889df0-6e2b-4fbe-93b1-de7c543efab1 admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:17.583283 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-d2889df0-6e2b-4fbe-93b1-de7c543efab1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Apr 12 14:46:17.583679 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:17.646482 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-c07ea8cb-b668-4ad2-8455-5ca233dc9b7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "id": "d4"}} {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:17.726779 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-c07ea8cb-b668-4ad2-8455-5ca233dc9b7a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137167 Apr 12 14:46:17.727395 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Apr 12 14:46:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 14:46:17.739511 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-87145def-ae12-4243-9539-8107dc1df1e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:17.815453 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-87145def-ae12-4243-9539-8107dc1df1e8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079441 Apr 12 14:46:17.816494 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Tue Apr 12 14:46:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:46:20.214788 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-c07ea8cb-b668-4ad2-8455-5ca233dc9b7a admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:20.215805 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-c07ea8cb-b668-4ad2-8455-5ca233dc9b7a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Apr 12 14:46:20.216290 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:20.279285 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-be0d1552-570f-4a1e-a507-dffdd51e093d admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:20.302724 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-be0d1552-570f-4a1e-a507-dffdd51e093d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077468 Apr 12 14:46:20.303383 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Tue Apr 12 14:46:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:46:22.719814 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-c07ea8cb-b668-4ad2-8455-5ca233dc9b7a admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:22.719814 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-c07ea8cb-b668-4ad2-8455-5ca233dc9b7a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 Apr 12 14:46:22.719814 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:22.802304 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-9abe79db-1c80-4873-aa64-aa1a4596594f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "disk": 1, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:23.173717 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-9abe79db-1c80-4873-aa64-aa1a4596594f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.447134 Apr 12 14:46:23.174433 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Apr 12 14:46:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:46:23.191494 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-5b747ad9-ae1f-4270-a46e-8b473bb5623d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:23.299565 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-5b747ad9-ae1f-4270-a46e-8b473bb5623d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112492 Apr 12 14:46:23.300308 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Tue Apr 12 14:46:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:46:25.860695 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-9abe79db-1c80-4873-aa64-aa1a4596594f admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:25.862048 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-9abe79db-1c80-4873-aa64-aa1a4596594f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001893 Apr 12 14:46:25.862700 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:25.929395 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-8ee2b1a9-f4f9-4d65-af73-1c857974ab72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:26.094421 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-8ee2b1a9-f4f9-4d65-af73-1c857974ab72 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.225779 Apr 12 14:46:26.095083 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Apr 12 14:46:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:46:26.110039 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-2082ec84-95f2-41a0-947f-fae78760a350 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:26.279604 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-2082ec84-95f2-41a0-947f-fae78760a350 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.175863 Apr 12 14:46:26.280210 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Tue Apr 12 14:46:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:46:28.690772 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-8ee2b1a9-f4f9-4d65-af73-1c857974ab72 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:28.691827 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-8ee2b1a9-f4f9-4d65-af73-1c857974ab72 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Apr 12 14:46:28.692257 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:28.754828 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-32f641d2-5e52-467c-9cae-8440b96e3ce6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:28.874862 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-32f641d2-5e52-467c-9cae-8440b96e3ce6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.176416 Apr 12 14:46:28.875339 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Apr 12 14:46:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:46:28.887323 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-f0070d5b-4c90-4909-b30f-afc5ea4c82e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:28.998507 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-f0070d5b-4c90-4909-b30f-afc5ea4c82e6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114326 Apr 12 14:46:28.999212 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Tue Apr 12 14:46:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:46:31.426445 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-32f641d2-5e52-467c-9cae-8440b96e3ce6 admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:31.427515 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-32f641d2-5e52-467c-9cae-8440b96e3ce6 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Apr 12 14:46:31.427919 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:31.487405 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-55355774-be3d-4d02-b03b-dae42fead784 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:31.663566 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-55355774-be3d-4d02-b03b-dae42fead784 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.229532 Apr 12 14:46:31.664112 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Apr 12 14:46:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:46:31.678605 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-94d953ee-ad78-41c5-a554-beb683e5e2f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:31.803363 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-94d953ee-ad78-41c5-a554-beb683e5e2f7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130572 Apr 12 14:46:31.803949 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Tue Apr 12 14:46:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:46:34.241248 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-55355774-be3d-4d02-b03b-dae42fead784 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:34.242556 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-55355774-be3d-4d02-b03b-dae42fead784 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 Apr 12 14:46:34.243105 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:46:34.311274 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-534411bb-18a3-47ae-90fb-754009ed9f09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:34.435729 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-534411bb-18a3-47ae-90fb-754009ed9f09 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.185699 Apr 12 14:46:34.436209 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Apr 12 14:46:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 14:46:34.447944 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-ac3c62b5-6b08-4ae2-a46f-4669ccbe8869 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:46:34.537147 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-ac3c62b5-6b08-4ae2-a46f-4669ccbe8869 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092948 Apr 12 14:46:34.538036 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Tue Apr 12 14:46:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:46:59.995758 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-534411bb-18a3-47ae-90fb-754009ed9f09 admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:46:59.996677 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-534411bb-18a3-47ae-90fb-754009ed9f09 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Apr 12 14:46:59.997096 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:47:00.070266 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-bc0af923-697c-4432-8499-942f32e48dcf admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:00.087372 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-bc0af923-697c-4432-8499-942f32e48dcf admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.082882 Apr 12 14:47:00.087922 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Tue Apr 12 14:47:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:47:01.516283 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-534411bb-18a3-47ae-90fb-754009ed9f09 admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:01.517287 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-534411bb-18a3-47ae-90fb-754009ed9f09 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Apr 12 14:47:01.517703 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:47:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:47:01.753746 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-0332a159-d385-4a8d-a7b1-b28b74ad4737 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:01.760149 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.wsgi [None req-0332a159-d385-4a8d-a7b1-b28b74ad4737 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 12 14:47:01.760732 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-0332a159-d385-4a8d-a7b1-b28b74ad4737 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:47:01.761551 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-0332a159-d385-4a8d-a7b1-b28b74ad4737 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065553 Apr 12 14:47:01.762163 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Apr 12 14:47:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 14:47:01.774192 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-7432e819-b592-470e-b980-985a7788b97c admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:01.796768 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-7432e819-b592-470e-b980-985a7788b97c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026138 Apr 12 14:47:01.797353 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Apr 12 14:47:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:47:01.807276 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-bf7b293a-83b3-4e43-8889-e2d3cf218d82 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:01.828476 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-bf7b293a-83b3-4e43-8889-e2d3cf218d82 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024776 Apr 12 14:47:01.829177 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Apr 12 14:47:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:47:01.838825 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-d7e16678-687f-4f94-8e4f-a331616ed6c8 admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:01.845179 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.wsgi [None req-d7e16678-687f-4f94-8e4f-a331616ed6c8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 12 14:47:01.846036 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-d7e16678-687f-4f94-8e4f-a331616ed6c8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:47:01.846960 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-d7e16678-687f-4f94-8e4f-a331616ed6c8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011822 Apr 12 14:47:01.847488 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Apr 12 14:47:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 12 14:47:03.165890 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-bf7b293a-83b3-4e43-8889-e2d3cf218d82 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:03.166975 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-bf7b293a-83b3-4e43-8889-e2d3cf218d82 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Apr 12 14:47:03.167372 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:47:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:47:03.366201 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-a727ce57-3652-4c61-bd5b-8d931cac8def admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:03.371521 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.wsgi [None req-a727ce57-3652-4c61-bd5b-8d931cac8def admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 12 14:47:03.372080 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-a727ce57-3652-4c61-bd5b-8d931cac8def admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:47:03.372888 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-a727ce57-3652-4c61-bd5b-8d931cac8def admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063564 Apr 12 14:47:03.373415 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Apr 12 14:47:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 14:47:03.388972 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-1c01878c-4e66-4371-9128-6bb2164e1728 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:03.405244 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-1c01878c-4e66-4371-9128-6bb2164e1728 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025543 Apr 12 14:47:03.406327 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Apr 12 14:47:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:47:03.416316 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-7854cae9-64ec-40d1-87de-bf5e38e55ec1 admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:03.431014 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-7854cae9-64ec-40d1-87de-bf5e38e55ec1 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018279 Apr 12 14:47:03.431584 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Apr 12 14:47:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:47:03.443814 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-9ded4c31-6559-4d85-8fbd-2800a538abd3 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:03.449123 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.wsgi [None req-9ded4c31-6559-4d85-8fbd-2800a538abd3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 12 14:47:03.455306 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-9ded4c31-6559-4d85-8fbd-2800a538abd3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:47:03.455306 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-9ded4c31-6559-4d85-8fbd-2800a538abd3 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012393 Apr 12 14:47:03.455306 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Apr 12 14:47:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 14:47:04.774528 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-7854cae9-64ec-40d1-87de-bf5e38e55ec1 admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:04.775448 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-7854cae9-64ec-40d1-87de-bf5e38e55ec1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Apr 12 14:47:04.775832 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:47:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:47:04.970176 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-6ba39043-dc5c-4327-a29a-21ded807fe04 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:04.977467 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.wsgi [None req-6ba39043-dc5c-4327-a29a-21ded807fe04 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 12 14:47:04.978067 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-6ba39043-dc5c-4327-a29a-21ded807fe04 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:47:04.978897 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-6ba39043-dc5c-4327-a29a-21ded807fe04 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062003 Apr 12 14:47:04.979417 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Apr 12 14:47:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 14:47:04.989058 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-3353638d-7125-427a-bf61-90f2aa9cee7a admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:05.002838 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-3353638d-7125-427a-bf61-90f2aa9cee7a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017279 Apr 12 14:47:05.003386 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Apr 12 14:47:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:47:05.013587 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:05.027462 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017774 Apr 12 14:47:05.028030 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Apr 12 14:47:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:47:05.038670 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-6a310904-e4e3-4036-9c52-795026aa8a12 admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:05.044231 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.wsgi [None req-6a310904-e4e3-4036-9c52-795026aa8a12 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 12 14:47:05.044826 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-6a310904-e4e3-4036-9c52-795026aa8a12 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:47:05.045602 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-6a310904-e4e3-4036-9c52-795026aa8a12 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010831 Apr 12 14:47:05.046118 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Apr 12 14:47:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 14:47:06.322348 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:06.323388 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Apr 12 14:47:06.323853 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:47:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:47:06.518747 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-34e5d40e-019d-4260-bc3f-40c50eb9998d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:47:06.651773 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-34e5d40e-019d-4260-bc3f-40c50eb9998d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.190598 Apr 12 14:47:06.652320 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Apr 12 14:47:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:47:07.939943 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:07.940943 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Apr 12 14:47:07.941343 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:47:08.132899 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-22d1c62c-4f3c-4804-b7cf-5c05612df492 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:47:08.279761 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-22d1c62c-4f3c-4804-b7cf-5c05612df492 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.199670 Apr 12 14:47:08.280318 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Apr 12 14:47:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 14:47:09.576554 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:09.578221 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Apr 12 14:47:09.578221 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:47:09.767553 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-137e7022-2881-477d-9d64-b6ce5c416552 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:47:09.862253 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-137e7022-2881-477d-9d64-b6ce5c416552 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.147871 Apr 12 14:47:09.862719 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Apr 12 14:47:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:47:11.162385 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:11.163386 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Apr 12 14:47:11.163797 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:47:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:47:11.358999 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-62d6540a-d2cc-4289-ac39-dd94e14c8abf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:47:11.469331 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-62d6540a-d2cc-4289-ac39-dd94e14c8abf admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.167682 Apr 12 14:47:11.469813 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Apr 12 14:47:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:47:12.771563 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:12.772566 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Apr 12 14:47:12.772971 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:47:12.966267 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-785dc51c-0855-41b0-84f5-a79dc9cedbcb admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:47:12.985757 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-785dc51c-0855-41b0-84f5-a79dc9cedbcb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073619 Apr 12 14:47:12.986300 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Tue Apr 12 14:47:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:48:20.403099 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:48:20.404197 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-0d27f3f2-26af-4c3f-8a5a-2e7b08b336de admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Apr 12 14:48:20.404598 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Tue Apr 12 14:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:48:20.466536 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-6c8e35ed-9cde-4409-8c82-6d819dc8fa8f admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:48:20.485925 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-6c8e35ed-9cde-4409-8c82-6d819dc8fa8f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075029 Apr 12 14:48:20.486453 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Tue Apr 12 14:48:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:48:20.509075 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-8eaab485-033a-46a4-baf9-3ef49a93368f admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:48:20.517185 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-8eaab485-033a-46a4-baf9-3ef49a93368f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012254 Apr 12 14:48:20.517770 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Tue Apr 12 14:48:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:48:20.529001 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-d3c74acb-588f-498d-b799-cff3229ce4ae admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:48:20.536579 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-d3c74acb-588f-498d-b799-cff3229ce4ae admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011270 Apr 12 14:48:20.537106 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Tue Apr 12 14:48:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:48:20.549113 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-3bd4981e-b54b-4aa2-98aa-83c0aaa80a3b admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:48:20.556685 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-3bd4981e-b54b-4aa2-98aa-83c0aaa80a3b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011204 Apr 12 14:48:20.557209 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Tue Apr 12 14:48:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:48:20.569279 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-43cf0cbd-8a3e-4920-8326-4bd7850a371b admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:48:20.577301 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-43cf0cbd-8a3e-4920-8326-4bd7850a371b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011728 Apr 12 14:48:20.577862 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Tue Apr 12 14:48:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:50:17.997550 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-a4d31671-64a6-466b-b01d-1c9906006914 tempest-verify_tempest_config-667116314 tempest-verify_tempest_config-667116314-project] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:50:17.999550 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-a4d31671-64a6-466b-b01d-1c9906006914 tempest-verify_tempest_config-667116314 tempest-verify_tempest_config-667116314-project] 10.222.0.64 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121588 Apr 12 14:50:18.000089 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 34/69] 10.222.0.64 () {58 vars in 1133 bytes} [Tue Apr 12 14:50:17 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:52:02.965147 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-43cf0cbd-8a3e-4920-8326-4bd7850a371b admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:52:02.966196 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-43cf0cbd-8a3e-4920-8326-4bd7850a371b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Apr 12 14:52:02.966593 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 36/70] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:52:03.229713 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-63885ba9-cf91-446d-91ec-e1b76e0244b2 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:52:03.230892 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:52:03.230892 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: warnings.warn(msg) Apr 12 14:52:03.232146 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-63885ba9-cf91-446d-91ec-e1b76e0244b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:52:03.232616 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-63885ba9-cf91-446d-91ec-e1b76e0244b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:52:03.233403 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-63885ba9-cf91-446d-91ec-e1b76e0244b2 admin admin] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:52:03.233872 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-63885ba9-cf91-446d-91ec-e1b76e0244b2 admin admin] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:52:03.268817 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-63885ba9-cf91-446d-91ec-e1b76e0244b2 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.158729 Apr 12 14:52:03.269394 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 35/71] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Apr 12 14:52:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 14:52:04.591997 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-43cf0cbd-8a3e-4920-8326-4bd7850a371b admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:52:04.593117 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-43cf0cbd-8a3e-4920-8326-4bd7850a371b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Apr 12 14:52:04.593509 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 37/72] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:52:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:52:04.802031 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-aa53d293-3f81-4cc5-861c-a38b6acf25eb admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:52:04.803296 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:52:04.803296 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: warnings.warn(msg) Apr 12 14:52:04.804486 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-aa53d293-3f81-4cc5-861c-a38b6acf25eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:52:04.804955 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-aa53d293-3f81-4cc5-861c-a38b6acf25eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:52:04.805775 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-aa53d293-3f81-4cc5-861c-a38b6acf25eb admin admin] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:52:04.806207 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-aa53d293-3f81-4cc5-861c-a38b6acf25eb admin admin] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:52:04.827324 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-aa53d293-3f81-4cc5-861c-a38b6acf25eb admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085676 Apr 12 14:52:04.827893 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 36/73] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Apr 12 14:52:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:52:16.716157 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-43cf0cbd-8a3e-4920-8326-4bd7850a371b admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:52:16.717186 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-43cf0cbd-8a3e-4920-8326-4bd7850a371b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Apr 12 14:52:16.717577 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 38/74] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:52:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:52:16.914159 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-aa854190-9e8f-4212-b31e-20536bdc5913 admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:52:16.915390 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:52:16.915390 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: warnings.warn(msg) Apr 12 14:52:16.916574 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-aa854190-9e8f-4212-b31e-20536bdc5913 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:52:16.917015 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-aa854190-9e8f-4212-b31e-20536bdc5913 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:52:16.917860 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-aa854190-9e8f-4212-b31e-20536bdc5913 admin admin] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:52:16.918285 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-aa854190-9e8f-4212-b31e-20536bdc5913 admin admin] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:52:16.942865 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-aa854190-9e8f-4212-b31e-20536bdc5913 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081460 Apr 12 14:52:16.943421 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 37/75] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Apr 12 14:52:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:52:18.263981 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: DEBUG nova.api.openstack.wsgi [None req-43cf0cbd-8a3e-4920-8326-4bd7850a371b admin admin] Calling method '>' {{(pid=109786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:52:18.264981 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: INFO nova.api.openstack.requestlog [None req-43cf0cbd-8a3e-4920-8326-4bd7850a371b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Apr 12 14:52:18.265371 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: [pid: 109786|app: 0|req: 39/76] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Apr 12 14:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:52:18.461694 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG nova.api.openstack.wsgi [None req-f940ccc5-7b8b-4fd2-aa90-a2b10b95b14b admin admin] Calling method '>' {{(pid=109787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:52:18.462872 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 14:52:18.462872 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: warnings.warn(msg) Apr 12 14:52:18.464109 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-f940ccc5-7b8b-4fd2-aa90-a2b10b95b14b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:52:18.464554 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-f940ccc5-7b8b-4fd2-aa90-a2b10b95b14b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:52:18.465401 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-f940ccc5-7b8b-4fd2-aa90-a2b10b95b14b admin admin] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:52:18.465871 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: DEBUG oslo_concurrency.lockutils [None req-f940ccc5-7b8b-4fd2-aa90-a2b10b95b14b admin admin] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:52:18.487528 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: INFO nova.api.openstack.requestlog [None req-f940ccc5-7b8b-4fd2-aa90-a2b10b95b14b admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081437 Apr 12 14:52:18.488012 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: [pid: 109787|app: 0|req: 38/77] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Apr 12 14:52:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:53:18.994039 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: Tue Apr 12 14:53:18 2022 - graceful shutdown triggered... Apr 12 14:53:18.994170 dv-cinder-837524-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 12 14:53:18.995285 dv-cinder-837524-1-iscsi devstack@n-api.service[109786]: Gracefully killing worker 1 (pid: 109786)... Apr 12 14:53:18.995687 dv-cinder-837524-1-iscsi devstack@n-api.service[109787]: Gracefully killing worker 2 (pid: 109787)... Apr 12 14:53:19.996469 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: worker 1 buried after 1 seconds Apr 12 14:53:19.996469 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: worker 2 buried after 1 seconds Apr 12 14:53:19.996469 dv-cinder-837524-1-iscsi devstack@n-api.service[109785]: goodbye to uWSGI. Apr 12 14:53:19.998029 dv-cinder-837524-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 12 14:53:19.998606 dv-cinder-837524-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 12 14:53:20.001426 dv-cinder-837524-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 12 14:53:20.018845 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 12 14:53:20 2022] *** Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: nodename: dv-cinder-837524-1-iscsi Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: machine: x86_64 Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: clock source: unix Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: pcre jit disabled Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: detected number of CPU cores: 4 Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: current working directory: / Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: detected binary path: /usr/bin/uwsgi-core Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: your processes number limit is 47680 Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: your memory page size is 4096 bytes Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: detected max file descriptor number: 2048 Apr 12 14:53:20.049441 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: lock engine: pthread robust mutexes Apr 12 14:53:20.051627 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: thunder lock: enabled Apr 12 14:53:20.051627 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 14:53:20.051627 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 12 14:53:20.100355 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: Python main interpreter initialized at 0x5563178619c0 Apr 12 14:53:20.100355 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: python threads support enabled Apr 12 14:53:20.100355 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: your server socket listen backlog is limited to 100 connections Apr 12 14:53:20.100355 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: your mercy for graceful operations on workers is 90 seconds Apr 12 14:53:20.100805 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: mapped 403077 bytes (393 KB) for 2 cores Apr 12 14:53:20.100805 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: *** Operational MODE: preforking *** Apr 12 14:53:20.101098 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: *** uWSGI is running in multiple interpreter mode *** Apr 12 14:53:20.101098 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: spawned uWSGI master process (pid: 124182) Apr 12 14:53:20.101620 dv-cinder-837524-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 12 14:53:20.105596 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: spawned uWSGI worker 1 (pid: 124198, cores: 1) Apr 12 14:53:20.105596 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: spawned uWSGI worker 2 (pid: 124199, cores: 1) Apr 12 14:53:20.105596 dv-cinder-837524-1-iscsi devstack@n-api.service[124182]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 14:53:21.358906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 14:53:21.382218 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 14:53:22.311030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:53:22.311030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: from cryptography.utils import int_from_bytes Apr 12 14:53:22.311377 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:53:22.311377 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: from cryptography.utils import int_from_bytes Apr 12 14:53:22.344244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:53:22.344244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: from cryptography.utils import int_from_bytes Apr 12 14:53:22.344559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 14:53:22.344559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: from cryptography.utils import int_from_bytes Apr 12 14:53:24.788224 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 14:53:24.788777 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 14:53:24.789060 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 14:53:24.789310 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 14:53:24.789588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 14:53:24.789988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.790319 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.790648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.790978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.791309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.791627 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.791960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.792286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.792618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.792882 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.793204 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.793536 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837524-1-iscsi {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.794438 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.794726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.795031 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.795421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.795745 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.796128 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.796443 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.796958 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.798473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.798473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.798473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.798837 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.799145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.799368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.799697 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.799983 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.800336 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.800666 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.801047 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837524-1-iscsi {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.801364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.801699 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.802036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.802447 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.802784 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.805595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.805595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.805595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.805595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.805595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.805595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.805595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.805595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.807400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.807400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.807400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.807400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.807400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.807400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.807400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.808730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.808730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.808730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.808730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.809547 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.809547 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.809547 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.810285 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.810285 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.810735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.810970 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.811187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.812024 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.812024 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.812024 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.812484 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.812649 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.813138 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.813305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.813584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.813935 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.814350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.814606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.815035 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.815813 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.815813 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.816137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.816295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.816456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 14:53:24.816975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.817140 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 14:53:24.817284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.817426 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 14:53:24.817567 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.817567 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.817926 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 14:53:24.817926 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 14:53:24.818205 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.818346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.818494 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.818494 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.818781 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.818952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.819107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.819257 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.819409 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.819568 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.819710 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.819853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.820002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.820144 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.820298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.820583 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.820742 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.820892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.821045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.821195 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.821346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.821500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.822244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.822398 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.822551 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837524-1-iscsi {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.822714 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.822872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.823051 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.823229 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.823825 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.823989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.824147 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.824297 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.824450 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.824592 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.824743 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.824930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.825139 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.825298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.825450 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.825718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.825910 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.826069 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.826220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.826374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.826515 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.826656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.826804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.826956 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.827106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.827106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.827106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.827528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.827677 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.827837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.827837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.828120 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.828277 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.828419 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.828580 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.828580 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.828864 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.829751 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837524-1-iscsi {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.829919 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.830063 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.830063 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.830348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.830509 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.830661 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.830955 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.830955 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.831255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.831413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.831563 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.831717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.831717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.832550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.832709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.832709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.833009 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.833159 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.833305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.833476 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.833476 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.834547 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.834709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.834851 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.835002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.835002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.835267 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.835408 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.835408 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.835702 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.835851 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.835851 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.836116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.836269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.836420 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.836561 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.836561 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.836834 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.836975 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.836975 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.837257 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.837413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.837557 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.837743 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.837743 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.838035 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.838177 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.838177 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.838459 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.838607 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.838607 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.838888 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.839037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.839200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.839341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.839341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.839634 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.839778 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.839778 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.840060 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.840210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.840351 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.841037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.841202 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.841525 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.841708 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.841968 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.842210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.842879 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.842879 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.843169 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.843320 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.843320 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.843613 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.843762 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.843911 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.844081 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.844081 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.844824 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.844989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.844989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.845265 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.845421 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.845570 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.845811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.845811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.846091 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.846233 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.846233 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.846513 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.846739 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.846739 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.847037 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.847188 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.847330 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.847484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.847669 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.847818 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.847982 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.848289 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.848437 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.848587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.848853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.849011 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.849193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.849385 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.850234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.850234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.850539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.850708 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.850708 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.851054 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.851245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.851445 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.851625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.851625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.852162 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.852340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.852340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.853213 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.853367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.853367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.853666 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.853826 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.853986 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.854130 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.854130 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.854957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.855120 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.855120 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.855418 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.855574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.855574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.855856 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.855999 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.856293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.856993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.856993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.857316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.857468 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.857468 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.857801 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.857954 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.858108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.858108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.858387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.858387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.858662 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.858811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.858959 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.859109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.859279 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.859429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.859577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.859883 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.860048 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.860274 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.860429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.860583 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.860783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.860939 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.861095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.861419 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.861614 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.861878 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.862028 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.862170 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.862347 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.862531 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.862689 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 14:53:24.863061 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.863512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.863656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.863805 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.863957 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.863957 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.864262 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.864404 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.864571 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.865165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.865165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.865492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.865671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.865671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.865950 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.866091 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.866248 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.866390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.866540 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.866680 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.866829 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.867010 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.867221 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.867411 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.867556 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.867704 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.867847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.867994 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.868147 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.868289 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.868429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.868570 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.868718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.868868 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.869010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.869166 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.869319 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.869468 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.869676 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.869841 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.870042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.870193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.870352 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.870503 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.870645 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.870799 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.870942 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.871094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.871243 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.871397 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.871538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.871688 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.871930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.872179 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.872494 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.872681 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.872836 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.873173 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.873621 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.873848 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.873848 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.874155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.874307 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.874459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.874600 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.874759 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.875076 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.875436 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.875593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.875744 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.875886 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.876043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.876186 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.876342 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.876342 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.876650 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.876801 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.876944 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.877085 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.877236 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.877425 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.877581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.877809 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.877952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.878105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.878262 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.878413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.878567 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.878892 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.879048 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.879192 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.879344 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.879494 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.879637 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.879778 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.879926 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.880075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.880234 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.880388 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.880538 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.880700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.880849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.881006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.881157 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.881307 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.881449 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.881591 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.881759 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.881914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.882058 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.882244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.882398 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.882558 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.882708 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.882865 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.883015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.883375 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.883804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.883958 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.884118 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.884271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.884422 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.884565 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.884706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.884848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.884848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.885358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.885358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.885358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.886100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.886244 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.886394 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.886544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.886693 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.887058 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.887213 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.887359 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.887570 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.887735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.887946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.888109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.888259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.888408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.888408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.888686 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.888828 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.889002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.889231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.889231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.889546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.889718 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.889877 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.889877 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.890199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.890425 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.890570 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.890711 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.890863 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.891005 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.891154 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.891154 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.891437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.891576 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.891738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.891894 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.892036 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.892186 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.892335 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.892484 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.892632 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.892781 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.892932 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.893107 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.893654 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.894102 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.894262 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.894417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.894573 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.894715 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.894864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.895013 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.895350 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.895500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.895672 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.896064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.896215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.896358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.896500 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.896648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.896811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.896953 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.897102 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.897243 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.897384 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.897534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.897710 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.897860 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.898001 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.898141 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.898312 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.898587 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.898747 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.898901 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.899043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.899185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.899334 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.899491 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.899649 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.899792 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.899942 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.900091 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.900233 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.900382 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.900524 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.900673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.900824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.900965 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.901112 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.901269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.901411 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.901560 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.901776 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.901953 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.902140 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.902316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.902472 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.902622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.902783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.902925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.903926 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.904391 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.904551 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.904695 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.904846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.904996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.905157 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.905511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.905680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.905841 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.906011 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.906428 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.906582 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.906724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.906866 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.907007 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.907156 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.907156 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.907446 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.907595 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.907744 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.907894 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.908035 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.908185 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.908345 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.908488 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.908628 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.908628 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.908904 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.909056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.909206 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.909354 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.909503 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.909697 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.909971 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.910137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.910281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.910439 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.910581 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.910721 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.910869 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.911020 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.911171 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.911328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.911479 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.911689 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.911898 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.912056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.912251 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.912392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.912552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.912702 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.912853 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.913003 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.913154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.913295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.913483 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.913665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.914100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.914539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.914699 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.914861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.915034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.915210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.915425 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.915763 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.915914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.916063 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.916231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.916637 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.916789 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.916938 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.917088 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.917230 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.917380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.917547 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.917724 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.918024 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.918196 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.918389 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.918577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.918577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.919628 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.919775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.919923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.920252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.920473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.920654 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.920855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.921002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.921182 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.921340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.921565 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.921784 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.921993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.922188 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.922337 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.922479 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.922637 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.922781 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.922935 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.923098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.923325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.923470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.923613 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.923754 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.923903 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.924249 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.924417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.929864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.931714 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.931885 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.932045 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.932045 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.932330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.932484 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.932635 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.932787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.932938 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.933090 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.933253 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.933396 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.933538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.933756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.933907 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.934049 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.935137 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.935375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.935560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.935705 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.935855 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.935998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.936232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.936386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.936538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.936681 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.936831 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.936981 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.937736 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.937894 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.938051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.938195 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.938346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.938501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.938643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.938784 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.938934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.939113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.939274 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.939436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.940138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.940293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.940448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.940604 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.940755 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.941025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.941206 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.941368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.941529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.941777 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.941954 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.942120 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.942120 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.942471 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.942736 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.942977 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.943213 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.943469 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.943726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.943995 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.944231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.944665 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.944848 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.944848 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.945288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.945288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.945773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.945773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.946082 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.946231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.946394 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.946565 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.946731 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.946881 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.947037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.947186 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.947334 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.947489 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.947638 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.947795 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.947954 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.948111 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.948260 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.948408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.948567 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.948770 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.948929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.949085 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.949234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.949393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.949557 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.951059 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.951373 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.951798 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.952002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.952002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.952002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.952735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.952929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.952929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.953323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.953501 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.953733 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.953963 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.954168 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.954380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.954602 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.955171 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.955514 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.955683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.955909 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.956072 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.956233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.956383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.956546 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.956704 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.956861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.957009 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.957159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.957159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.957451 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.957601 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.957808 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.957999 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.958158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.958317 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.958477 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.958884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.959051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.959208 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.959368 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.959532 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.959690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.959857 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.959857 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.960440 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.960604 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.960768 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.960919 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.961263 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.961263 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.961665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.961838 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.961997 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.962155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.962304 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.962454 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.962648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.962812 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.962970 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.963119 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.963273 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.963428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.963578 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.963735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.963884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.964032 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.964181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.964329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.964329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.964697 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.964965 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.964965 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.965323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.965525 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.965892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.966064 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.966223 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.966382 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.966540 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.966690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.966847 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.967005 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.967155 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.967322 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.967478 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.967626 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.967783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.967939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.968096 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.968291 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.968462 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.968671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.968849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.969008 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.969164 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.969164 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.969464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.969464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.969797 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.969948 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.970115 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.970484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.970747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.970968 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.971194 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.971692 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.971893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.972066 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.972281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.972443 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.972714 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.972908 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.973066 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.973281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.973438 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.973695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.973890 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.974062 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.974271 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.974437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.974628 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.974824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.975143 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.975415 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.975599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.975791 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.976090 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.976265 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.976424 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.976573 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.976756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.976951 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.977151 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.977323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.977485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.977721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.977891 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.978060 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.978290 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.979027 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.979209 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.979394 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.979639 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.979848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.980027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.980204 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.980596 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.980871 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.981038 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.981330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.981518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.981998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.982170 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.982371 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.982534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.982699 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.982857 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.983014 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.983163 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.983323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.983472 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.983628 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.983777 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.983925 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.984079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.984238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.984386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.984544 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.984699 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.984848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.985007 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.985266 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.986357 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.986535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.986535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.986829 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.986986 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.987143 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.987299 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.987461 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.987619 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.987768 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.987916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.988103 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.988265 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.988436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.988584 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.988740 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.988888 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.989036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.989193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.989348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.989495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.989495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.989495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.989940 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.990101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.990256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.990415 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.990747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.991017 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.991181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.991381 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.991545 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.991693 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.992134 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.992302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.992467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.992615 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.992771 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.992939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.992939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.993237 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.993395 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.993551 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.993757 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.993912 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.994075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.994224 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.994386 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.994542 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.994691 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.994852 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.995044 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.995245 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.995551 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.995790 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.995946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.996095 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.996546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.997275 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.997507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.997691 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.997880 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.998047 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.998239 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.998453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.998647 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.998849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.999003 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.999222 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.999388 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.999550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.999700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.999849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:24.999998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.000186 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.000352 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.000352 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.000686 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.001045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.001248 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.001402 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.001683 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.001854 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.002341 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.002519 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.002679 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.002828 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.002991 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.003150 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.003313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.003468 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.003631 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.003788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.003945 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.004102 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.004293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.004457 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.004661 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.004825 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.005057 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.005271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.005963 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006065 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006191 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006283 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006466 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006556 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006556 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.006960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007116 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007197 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007277 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007593 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007674 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007747 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007818 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007888 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007987 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.007987 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008455 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008551 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008633 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008718 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008801 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.008972 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009046 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009121 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009219 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009294 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009458 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009744 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009915 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.009987 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010071 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010223 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010454 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010540 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010614 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010693 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010772 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010845 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.010930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011003 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011144 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011215 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011286 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011443 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011522 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011594 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011664 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011823 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011903 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.011982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.012054 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.012124 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.012209 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.012290 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.012369 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.012495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.013075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.013169 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.013276 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.013399 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.013532 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.013623 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.013770 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.013770 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014108 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014322 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014401 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014487 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014631 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014701 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014779 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014850 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.014934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015015 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015307 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015410 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015410 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015604 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015760 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.015864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016024 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016157 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016536 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016715 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016878 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.016969 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.017042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.017128 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.017212 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.017304 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.017390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.017487 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.017574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.017574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.017758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.017899 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018099 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018276 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018361 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018453 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018545 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018830 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.018931 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019018 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019463 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019547 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019795 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.019963 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020054 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020140 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020238 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020333 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020419 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020511 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020703 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020797 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.020975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.021119 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.021254 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.021418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.021418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.021726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.021840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.021934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.022020 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.022126 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.022221 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.022308 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.022438 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.022550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.022686 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.022813 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.022926 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.023047 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.023143 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.023242 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.023354 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.023449 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.023535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.023666 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.023775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.023920 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.023920 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.024168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.024263 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.024357 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.024455 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.024625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.024722 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.024808 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.024892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.024985 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025071 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025258 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025343 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025427 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025427 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025598 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025598 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025897 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.025983 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026151 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026317 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026391 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026463 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026534 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026615 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026689 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026768 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026920 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.026993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027078 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027237 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027309 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027381 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027461 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027617 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027689 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027767 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.027906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.028059 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.028685 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.028841 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.028974 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.029106 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.029227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.029386 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.029506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.029624 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.029624 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.029944 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030039 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030306 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030482 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030581 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030667 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030759 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030845 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.030930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.031021 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.031119 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.031251 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.031365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.031477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.031579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.031665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.031765 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.031858 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.031943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032204 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032391 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032483 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032570 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032654 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032751 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.032930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.033014 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.033105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.033204 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.033298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.033298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.033454 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.033538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.033622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.033751 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.033889 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.034023 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.034129 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.034256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.034369 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.034508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.034598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.034683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.034776 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.034869 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.034955 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035054 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035140 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035225 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035401 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035663 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035663 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035826 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.035918 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036104 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036190 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036344 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036504 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036670 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036755 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036839 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.036971 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.037074 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.037161 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.037245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.037330 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.037414 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.037511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.037606 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.037747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.037836 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.037922 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.038049 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.038142 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.038288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.038394 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.038482 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.038482 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.038650 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.038750 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.038844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.038939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039033 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039118 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039118 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039285 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039360 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039459 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039637 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039722 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039908 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.039993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.040077 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.040160 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.040244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.040396 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.040501 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.040717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.040811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.041078 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.041203 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.041357 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.041441 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.041757 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.041869 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.042016 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.042128 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.042333 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.042435 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.042652 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.042752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.042968 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.043095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.043286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.043381 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.043601 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.043779 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.044683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.044835 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.044918 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.044992 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.045145 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.045307 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.045480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.045837 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.045961 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.046051 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.046136 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.046345 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.046493 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.046670 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.046779 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.046990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.047308 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.047411 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.047626 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.047720 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.047942 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.048035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.048267 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.048372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.048606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.048709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.048929 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.049031 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.049241 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.049359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.049554 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.049696 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.049931 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.050074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.050302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.050471 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.050650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.050787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.050971 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.051110 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.051312 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.051442 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.051627 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.051775 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.051945 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.052138 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.052289 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.052561 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.052643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.052884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.052978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.053216 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.053317 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.053533 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.053720 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.053872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.053986 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.054193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.054288 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.054537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.054638 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.054854 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.054982 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.055168 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.055260 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.055485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.055797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.055797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.056018 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.056116 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.056203 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.056412 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.056558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.056719 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.056814 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.057032 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.057125 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.057342 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.057443 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.057669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.057795 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.058045 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.058147 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.058412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.058539 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.058726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.058916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.059038 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.059239 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.059917 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.060102 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.060231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.060507 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.060611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.060821 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.060904 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.061131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.061235 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.061449 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.061543 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.061811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.061944 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.062129 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.062235 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.062441 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.062534 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.062753 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.062853 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.063066 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.063173 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.063408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.063502 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.063748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.063848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.064070 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.064172 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.064401 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.064495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.064715 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.064814 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.065033 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.065149 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.065348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.065441 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.065694 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.065791 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.066008 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.066101 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.066319 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.066411 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.066635 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.066766 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.066946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.067050 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.067256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.067392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.067571 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.067683 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.067882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.067980 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.068194 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.068287 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.068500 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.068611 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.068811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.068911 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.069121 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.069222 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.069452 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.069554 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.069858 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.069955 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.070372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.070495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.070706 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.070828 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.071023 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.071117 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.071336 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.071429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.071647 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.071741 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.071960 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.072095 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.072272 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.072401 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.072590 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.072718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.072912 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.073041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.073231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.073327 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.073549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.073682 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.073899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.074004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.074221 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.074324 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.074534 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.074627 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.074863 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.075585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.075755 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.075930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.076079 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.076169 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.076396 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.076487 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.076739 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.076928 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.077093 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.077254 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.077426 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.077576 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.077772 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.077923 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.078094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.078242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.078409 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.078559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.078657 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 14:53:25.078878 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.079216 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.079550 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.079864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.080197 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.080523 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.080849 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.081228 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.081496 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.081855 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.082174 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.082491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.082812 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.083129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.083449 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.084035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.084356 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.084691 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.085022 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.085356 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.085723 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.086084 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.086407 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.086760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.087097 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.087520 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.087844 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.088162 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 14:53:25.088411 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 14:53:25.102515 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_db.sqlalchemy.engines [None req-66700814-af6d-4662-b160-5bc61131a92e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:53:25.112093 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_db.sqlalchemy.engines [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:53:25.173147 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.context [None req-66700814-af6d-4662-b160-5bc61131a92e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),801f6a72-d6ac-4cbe-9661-63bd44124606(cell1) {{(pid=124199) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 14:53:25.177622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66700814-af6d-4662-b160-5bc61131a92e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:53:25.178563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.context [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),801f6a72-d6ac-4cbe-9661-63bd44124606(cell1) {{(pid=124198) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 14:53:25.179232 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66700814-af6d-4662-b160-5bc61131a92e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:53:25.180078 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66700814-af6d-4662-b160-5bc61131a92e None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:53:25.182050 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66700814-af6d-4662-b160-5bc61131a92e None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:53:25.182996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:53:25.185129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:53:25.186013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:53:25.189947 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:53:25.200779 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_db.sqlalchemy.engines [None req-66700814-af6d-4662-b160-5bc61131a92e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:53:25.200779 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_db.sqlalchemy.engines [None req-66700814-af6d-4662-b160-5bc61131a92e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:53:25.201578 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_db.sqlalchemy.engines [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:53:25.203080 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_db.sqlalchemy.engines [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:53:25.369610 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_db.sqlalchemy.engines [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:53:25.375601 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_db.sqlalchemy.engines [None req-66700814-af6d-4662-b160-5bc61131a92e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 14:53:25.828228 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: WARNING keystonemiddleware.auth_token [None req-66700814-af6d-4662-b160-5bc61131a92e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 14:53:25.828867 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: WARNING keystonemiddleware.auth_token [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 14:53:25.833152 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: WARNING keystonemiddleware.auth_token [None req-66700814-af6d-4662-b160-5bc61131a92e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 14:53:25.834372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: WARNING keystonemiddleware.auth_token [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 14:53:26.067236 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: WARNING keystonemiddleware.auth_token [None req-66700814-af6d-4662-b160-5bc61131a92e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 14:53:26.067459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: WARNING keystonemiddleware.auth_token [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 14:53:26.072513 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: WARNING keystonemiddleware.auth_token [None req-66700814-af6d-4662-b160-5bc61131a92e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 14:53:26.076228 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: WARNING keystonemiddleware.auth_token [None req-d543b9d0-cf56-41c2-9292-901eb7a35490 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 14:53:26.079017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5563178619c0 pid: 124199 (default app) Apr 12 14:53:26.082110 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5563178619c0 pid: 124198 (default app) Apr 12 14:54:12.058466 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-29f45602-d934-4b68-9c9f-032dc710af07 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] Action: 'create', calling method: .version_select at 0x7fbd62802a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-550873502", "metadata": {"Type": "work"}}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:14.121451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-29f45602-d934-4b68-9c9f-032dc710af07 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.260937 Apr 12 14:54:14.122822 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1155 bytes} [Tue Apr 12 14:54:10 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3264 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 12 14:54:14.481027 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-48430707-dfb6-445d-8910-15b9ab684112 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] Calling method '.version_select at 0x7fbd6284c5e0>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:14.812009 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-48430707-dfb6-445d-8910-15b9ab684112 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd" status: 200 len: 352 microversion: 2.1 time: 0.679742 Apr 12 14:54:14.819390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 1/2] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:54:14 2022] GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd => generated 352 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:54:15.139953 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-549827487", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "networks": [{"uuid": "11b6d2a6-a132-4634-b602-c76b53fbd922"}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:15.298408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] validate_networks() for [('11b6d2a6-a132-4634-b602-c76b53fbd922', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:54:15.827035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b6932690-46ae-4584-b40e-ce9e3bc6b354 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] Calling method '.version_select at 0x7fbd62713940>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:16.567651 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b6932690-46ae-4584-b40e-ce9e3bc6b354 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd" status: 200 len: 353 microversion: 2.1 time: 0.745839 Apr 12 14:54:16.574845 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:54:15 2022] GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd => generated 353 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:54:16.592805 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f563ecf2-cc17-4d45-9bf4-6ab2db0c8a3b tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] Calling method '.version_select at 0x7fbd626d5040>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:16.600257 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:54:16.601589 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:54:16.602127 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:54:16.602539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:54:16.603028 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:54:16.653454 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:16.663953 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:16.666718 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:16.668437 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:16.945292 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Getting quotas for project 83dc8d68f5f848fc8a1afce6f56d829e. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:16.945292 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Getting quotas for user c76c3495848448ce9bd3b77af8cbf8db and project 83dc8d68f5f848fc8a1afce6f56d829e. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:16.947455 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f563ecf2-cc17-4d45-9bf4-6ab2db0c8a3b tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd" status: 200 len: 353 microversion: 2.1 time: 0.210754 Apr 12 14:54:16.947455 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 3/4] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:54:16 2022] GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd => generated 353 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:54:16.947455 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fbe6d851-64e2-417d-835d-767557e38f1a tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] Calling method '.version_select at 0x7fbd62713e50>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:16.988047 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:54:16.988047 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:54:17.146424 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-51193270-506b-4b12-bde6-1e02af64a0fa tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.120394 Apr 12 14:54:17.147176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 2/5] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:54:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:54:17.164952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77c23cb7-008b-4b31-8a3b-633505430691 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:17.165589 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-77c23cb7-008b-4b31-8a3b-633505430691 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:17.223274 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fbe6d851-64e2-417d-835d-767557e38f1a tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd" status: 202 len: 0 microversion: 2.1 time: 0.418292 Apr 12 14:54:17.224180 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 4/6] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Apr 12 14:54:16 2022] DELETE /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 14:54:17.234650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-410fbebe-6d35-40d6-86ee-e16dea08bbff tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] Calling method '.version_select at 0x7fbd626d5430>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:17.353212 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-410fbebe-6d35-40d6-86ee-e16dea08bbff tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd" status: 200 len: 352 microversion: 2.1 time: 0.124275 Apr 12 14:54:17.353835 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 5/7] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:54:17 2022] GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:54:17.369020 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-77c23cb7-008b-4b31-8a3b-633505430691 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:17.396387 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-77c23cb7-008b-4b31-8a3b-633505430691 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1214 microversion: 2.1 time: 0.236127 Apr 12 14:54:17.403224 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 3/8] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:17 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1214 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:18.367550 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-84f3eebb-a3d6-4577-a0e2-39ae0c02f1ea tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] Calling method '.version_select at 0x7fbd626d5790>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:18.419117 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8ac95acc-ef54-4f31-b06f-0e8f3dd04365 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:18.421310 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8ac95acc-ef54-4f31-b06f-0e8f3dd04365 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:18.542290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-84f3eebb-a3d6-4577-a0e2-39ae0c02f1ea tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd" status: 200 len: 352 microversion: 2.1 time: 0.177880 Apr 12 14:54:18.548217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 6/9] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:54:18 2022] GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd => generated 352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:54:18.832769 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8ac95acc-ef54-4f31-b06f-0e8f3dd04365 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:18.841539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8ac95acc-ef54-4f31-b06f-0e8f3dd04365 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1214 microversion: 2.1 time: 0.426661 Apr 12 14:54:18.851996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 4/10] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:18 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1214 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:19.556712 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7183815e-2c2e-49ad-9856-e4c6d19572e0 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] Calling method '.version_select at 0x7fbd62713820>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:19.671234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7183815e-2c2e-49ad-9856-e4c6d19572e0 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd" status: 200 len: 352 microversion: 2.1 time: 0.118541 Apr 12 14:54:19.672505 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 7/11] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:54:19 2022] GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:54:19.873168 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3ffa452b-7b73-4a0d-b99d-5756823fa8cf tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:19.874610 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3ffa452b-7b73-4a0d-b99d-5756823fa8cf tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:19.894839 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ffa452b-7b73-4a0d-b99d-5756823fa8cf tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:19.895682 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ffa452b-7b73-4a0d-b99d-5756823fa8cf tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:19.896963 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ffa452b-7b73-4a0d-b99d-5756823fa8cf tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:19.902624 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ffa452b-7b73-4a0d-b99d-5756823fa8cf tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:20.248641 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3ffa452b-7b73-4a0d-b99d-5756823fa8cf tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:20.275081 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3ffa452b-7b73-4a0d-b99d-5756823fa8cf tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1218 microversion: 2.1 time: 0.408529 Apr 12 14:54:20.278766 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 5/12] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:19 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1218 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:20.684500 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-74a86abe-a409-477c-a362-56d9529f4190 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] Calling method '.version_select at 0x7fbd626d5c10>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:20.725448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-74a86abe-a409-477c-a362-56d9529f4190 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] HTTP exception thrown: Volume 2344012b-b535-484f-89a8-6bf46f6ccddd could not be found. Apr 12 14:54:20.726269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-74a86abe-a409-477c-a362-56d9529f4190 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] Returning 404 to user: Volume 2344012b-b535-484f-89a8-6bf46f6ccddd could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:54:20.727558 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-74a86abe-a409-477c-a362-56d9529f4190 tempest-VolumesGetTestJSON-482179662 tempest-VolumesGetTestJSON-482179662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd" status: 404 len: 109 microversion: 2.1 time: 0.047206 Apr 12 14:54:20.728639 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 8/13] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:54:20 2022] GET /compute/v2.1/os-volumes/2344012b-b535-484f-89a8-6bf46f6ccddd => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:54:21.296550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-370a937b-d312-4451-9346-8a77359b5aa7 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:21.298414 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-370a937b-d312-4451-9346-8a77359b5aa7 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:21.311392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-370a937b-d312-4451-9346-8a77359b5aa7 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:21.318932 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-370a937b-d312-4451-9346-8a77359b5aa7 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:21.320116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-370a937b-d312-4451-9346-8a77359b5aa7 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:21.322519 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-370a937b-d312-4451-9346-8a77359b5aa7 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:22.255083 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-370a937b-d312-4451-9346-8a77359b5aa7 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:22.265156 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-370a937b-d312-4451-9346-8a77359b5aa7 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1266 microversion: 2.1 time: 0.973118 Apr 12 14:54:22.266473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 6/14] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:21 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1266 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:23.284970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-becbe765-6d65-4756-8d25-a8ebd3664c95 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:23.286622 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-becbe765-6d65-4756-8d25-a8ebd3664c95 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:23.313378 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-becbe765-6d65-4756-8d25-a8ebd3664c95 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:23.313848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-becbe765-6d65-4756-8d25-a8ebd3664c95 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:23.314670 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-becbe765-6d65-4756-8d25-a8ebd3664c95 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:23.315392 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-becbe765-6d65-4756-8d25-a8ebd3664c95 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:24.225742 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-becbe765-6d65-4756-8d25-a8ebd3664c95 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:24.271541 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-becbe765-6d65-4756-8d25-a8ebd3664c95 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1272 microversion: 2.1 time: 0.991491 Apr 12 14:54:24.272753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 9/15] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:23 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1272 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:25.296514 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c81734fa-0863-4848-9872-befe8a39bde1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:25.298641 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c81734fa-0863-4848-9872-befe8a39bde1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:25.315138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c81734fa-0863-4848-9872-befe8a39bde1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:25.318213 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c81734fa-0863-4848-9872-befe8a39bde1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:25.319547 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c81734fa-0863-4848-9872-befe8a39bde1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:25.322071 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c81734fa-0863-4848-9872-befe8a39bde1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:25.368374 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4197c3d9-6545-4061-8d9d-978fefbe4fdd tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'create', calling method: .version_select at 0x7fbd614e0a60>, body: {"keypair": {"name": "tempest-keypair-776052136"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:25.462129 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-4197c3d9-6545-4061-8d9d-978fefbe4fdd tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:25.476393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-4197c3d9-6545-4061-8d9d-978fefbe4fdd tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for user d317bfa69daa49f286fd8c216e9f415a and project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:25.892736 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c81734fa-0863-4848-9872-befe8a39bde1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:25.907661 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c81734fa-0863-4848-9872-befe8a39bde1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1272 microversion: 2.1 time: 0.620878 Apr 12 14:54:25.920109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 10/16] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:25 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1272 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:26.679870 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-09a51222-7bd2-45ac-8b47-79c83566a06c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Action: 'create', calling method: .version_select at 0x7fbd625ce940>, body: {"keypair": {"name": "tempest-keypair-1523394437"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:26.778549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-4197c3d9-6545-4061-8d9d-978fefbe4fdd tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:26.789287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-4197c3d9-6545-4061-8d9d-978fefbe4fdd tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for user d317bfa69daa49f286fd8c216e9f415a and project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:26.824894 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-09a51222-7bd2-45ac-8b47-79c83566a06c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for project 7c2a576e2be74418bdef57686bad30a2. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:26.839887 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4197c3d9-6545-4061-8d9d-978fefbe4fdd tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.833311 Apr 12 14:54:26.849896 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 7/17] 10.222.0.64 () {60 vars in 1157 bytes} [Tue Apr 12 14:54:25 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:26.860353 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-09a51222-7bd2-45ac-8b47-79c83566a06c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for user 1719e64e58b14e63b4f2738410cf114f and project 7c2a576e2be74418bdef57686bad30a2. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:26.926628 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d246f68e-9181-4f3b-a509-d8b94728216f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:26.927827 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d246f68e-9181-4f3b-a509-d8b94728216f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:26.941898 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d246f68e-9181-4f3b-a509-d8b94728216f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:26.945953 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d246f68e-9181-4f3b-a509-d8b94728216f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:26.948455 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d246f68e-9181-4f3b-a509-d8b94728216f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:26.955015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d246f68e-9181-4f3b-a509-d8b94728216f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:27.198936 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d246f68e-9181-4f3b-a509-d8b94728216f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:27.216059 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d246f68e-9181-4f3b-a509-d8b94728216f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1272 microversion: 2.1 time: 0.294240 Apr 12 14:54:27.226767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 8/18] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:26 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1272 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:27.428393 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-09a51222-7bd2-45ac-8b47-79c83566a06c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for project 7c2a576e2be74418bdef57686bad30a2. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:27.449612 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-09a51222-7bd2-45ac-8b47-79c83566a06c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for user 1719e64e58b14e63b4f2738410cf114f and project 7c2a576e2be74418bdef57686bad30a2. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:27.505112 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-09a51222-7bd2-45ac-8b47-79c83566a06c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.060946 Apr 12 14:54:27.509205 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 11/19] 10.222.0.64 () {62 vars in 1198 bytes} [Tue Apr 12 14:54:26 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1066 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 12 14:54:28.239949 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3694a68e-083d-48df-9d6e-1b50ff974973 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:28.239949 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3694a68e-083d-48df-9d6e-1b50ff974973 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:28.245785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3694a68e-083d-48df-9d6e-1b50ff974973 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:28.252181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3694a68e-083d-48df-9d6e-1b50ff974973 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:28.258818 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3694a68e-083d-48df-9d6e-1b50ff974973 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:28.266470 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3694a68e-083d-48df-9d6e-1b50ff974973 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:30.526927 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3694a68e-083d-48df-9d6e-1b50ff974973 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:30.551373 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3694a68e-083d-48df-9d6e-1b50ff974973 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 2.310493 Apr 12 14:54:30.563336 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 9/20] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:28 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:31.568767 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-51095970-d65a-4779-afd3-acfa34af8a67 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:31.571096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-51095970-d65a-4779-afd3-acfa34af8a67 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:31.620299 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-51095970-d65a-4779-afd3-acfa34af8a67 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:31.620299 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-51095970-d65a-4779-afd3-acfa34af8a67 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:31.620299 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-51095970-d65a-4779-afd3-acfa34af8a67 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:31.620299 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-51095970-d65a-4779-afd3-acfa34af8a67 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:32.912448 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-469713624", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:33.106467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] validate_networks() for [('8f7bb313-4e99-4c79-b5eb-bf23757b656e', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:54:33.727612 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-51095970-d65a-4779-afd3-acfa34af8a67 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:33.752523 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-51095970-d65a-4779-afd3-acfa34af8a67 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 2.182392 Apr 12 14:54:33.760355 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 12/21] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:31 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:33.766925 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2146857895", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5444df66-cec9-4e6f-babf-6afcab69a266"}], "security_groups": [{"name": "tempest-securitygroup--162844749"}], "key_name": "tempest-keypair-1523394437", "user_data": "}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:34.533509 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] validate_networks() for [('5444df66-cec9-4e6f-babf-6afcab69a266', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:54:37.060758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:54:37.061558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:54:37.067651 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:54:37.067651 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:54:37.067651 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:54:37.090735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:37.092109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:37.093293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:37.094889 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:37.180381 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Getting quotas for project 566788e9e53f44db92dfad7ee91d6cd2. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:37.186679 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Getting quotas for user fb985e9c053f4c379f14c7ac21fb89bb and project 566788e9e53f44db92dfad7ee91d6cd2. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:37.204389 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:54:37.207561 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:54:37.472605 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bd402cba-7fc7-4ae6-9756-09c8c29e7ada tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.844442 Apr 12 14:54:37.477095 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 10/22] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:54:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 5854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:54:37.502407 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2942843f-10b3-43b8-838e-899e5992e694 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:37.502407 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2942843f-10b3-43b8-838e-899e5992e694 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:37.522509 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2942843f-10b3-43b8-838e-899e5992e694 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:37.524109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2942843f-10b3-43b8-838e-899e5992e694 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:37.527678 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2942843f-10b3-43b8-838e-899e5992e694 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:37.529727 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2942843f-10b3-43b8-838e-899e5992e694 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:38.971195 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:54:38.972334 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:54:38.973256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:54:38.973947 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:54:38.974566 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:54:38.993135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:38.995061 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:38.998709 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2942843f-10b3-43b8-838e-899e5992e694 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:39.008030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2942843f-10b3-43b8-838e-899e5992e694 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 1.523171 Apr 12 14:54:39.012230 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:39.014244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:39.016619 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:37 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:39.031049 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-40bc6691-6f41-479e-9cda-6c1852698d75 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:39.033307 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-40bc6691-6f41-479e-9cda-6c1852698d75 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:39.092007 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for project 7c2a576e2be74418bdef57686bad30a2. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:39.101744 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for user 1719e64e58b14e63b4f2738410cf114f and project 7c2a576e2be74418bdef57686bad30a2. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:39.123790 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:54:39.127858 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:54:39.210440 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-40bc6691-6f41-479e-9cda-6c1852698d75 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:39.221982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-40bc6691-6f41-479e-9cda-6c1852698d75 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1221 microversion: 2.1 time: 0.204061 Apr 12 14:54:39.224597 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 12/24] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:39 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1221 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:39.529617 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-3f57c209-3420-4f46-be9c-8c27cb3909cd req-477c6878-dfd8-418b-86c6-0cf784dbe222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d708580-277c-46d3-9972-57055255f9b9", "tag": "9f9def6f-5f72-486a-9964-ccea9979c6f0"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:39.549559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-3f57c209-3420-4f46-be9c-8c27cb3909cd req-477c6878-dfd8-418b-86c6-0cf784dbe222 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:39.550291 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-3f57c209-3420-4f46-be9c-8c27cb3909cd req-477c6878-dfd8-418b-86c6-0cf784dbe222 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:39.614295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-3f57c209-3420-4f46-be9c-8c27cb3909cd req-477c6878-dfd8-418b-86c6-0cf784dbe222 service nova] Creating event network-changed:9f9def6f-5f72-486a-9964-ccea9979c6f0 for instance 1d708580-277c-46d3-9972-57055255f9b9 on hv-cinder-83752 Apr 12 14:54:39.617733 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-3f57c209-3420-4f46-be9c-8c27cb3909cd req-477c6878-dfd8-418b-86c6-0cf784dbe222 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 12 14:54:39.621662 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9cac8ee-23fc-4bbc-8ea8-25726ea680fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:39.628877 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9cac8ee-23fc-4bbc-8ea8-25726ea680fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:39.636189 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9cac8ee-23fc-4bbc-8ea8-25726ea680fc None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:39.636189 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9cac8ee-23fc-4bbc-8ea8-25726ea680fc None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:39.656758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.compute.rpcapi [None req-c9cac8ee-23fc-4bbc-8ea8-25726ea680fc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 12 14:54:39.658520 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9cac8ee-23fc-4bbc-8ea8-25726ea680fc None None] Releasing lock "compute-rpcapi-router" {{(pid=124199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 14:54:39.672888 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-94d688d2-bff9-4472-accc-58256ae462ff tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.910766 Apr 12 14:54:39.673875 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 13/25] 10.222.0.64 () {62 vars in 1187 bytes} [Tue Apr 12 14:54:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 5913 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 12 14:54:39.683935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2128129749", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6cdec854-4846-4896-ad7e-f14d9793db5b"}], "security_groups": [{"name": "tempest-securitygroup--92948260"}], "key_name": "tempest-keypair-776052136", "user_data": "}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:39.708595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c9cac8ee-23fc-4bbc-8ea8-25726ea680fc None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.481791 Apr 12 14:54:39.709745 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 13/26] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:54:39.796120 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f2a2e527-d8f2-4269-b5d1-6b620dc69601 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: .version_select at 0x7fbd6148e310>, body: {"keypair": {"name": "tempest-keypair-1442849917"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:39.814244 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-f2a2e527-d8f2-4269-b5d1-6b620dc69601 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:39.819682 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-f2a2e527-d8f2-4269-b5d1-6b620dc69601 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:39.999571 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] validate_networks() for [('6cdec854-4846-4896-ad7e-f14d9793db5b', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:54:40.599617 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:54:40.599988 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:54:40.600492 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:54:40.600902 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:54:40.601315 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:54:40.611404 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:40.611858 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:40.612730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:40.613168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:40.630925 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:40.636120 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for user d317bfa69daa49f286fd8c216e9f415a and project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:40.651326 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:54:40.654537 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:54:40.696561 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-f2a2e527-d8f2-4269-b5d1-6b620dc69601 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:40.702811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-f2a2e527-d8f2-4269-b5d1-6b620dc69601 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:40.721292 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f2a2e527-d8f2-4269-b5d1-6b620dc69601 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.009903 Apr 12 14:54:40.722581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 14/27] 10.222.0.64 () {60 vars in 1157 bytes} [Tue Apr 12 14:54:39 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:40.735683 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1590349282", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:40.825809 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] validate_networks() for [('8f7bb313-4e99-4c79-b5eb-bf23757b656e', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:54:40.830187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-96d07884-9509-4348-a92b-f8e1fa12884a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.153453 Apr 12 14:54:40.839467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 14/28] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:54:39 2022] POST /compute/v2.1/servers => generated 400 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:54:40.849683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f99b4cb4-61c3-482b-91ef-337a835b5208 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:40.863157 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f99b4cb4-61c3-482b-91ef-337a835b5208 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:41.054043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f99b4cb4-61c3-482b-91ef-337a835b5208 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:41.079324 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f99b4cb4-61c3-482b-91ef-337a835b5208 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:41.081544 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f99b4cb4-61c3-482b-91ef-337a835b5208 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:41.099329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f99b4cb4-61c3-482b-91ef-337a835b5208 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1282 microversion: 2.20 time: 0.258625 Apr 12 14:54:41.109503 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 15/29] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:40 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1282 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:41.127638 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-eaaacfd7-64c4-4c72-b9be-96362fe34706 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:41.130207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-eaaacfd7-64c4-4c72-b9be-96362fe34706 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:41.175046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eaaacfd7-64c4-4c72-b9be-96362fe34706 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:41.176753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eaaacfd7-64c4-4c72-b9be-96362fe34706 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:41.180536 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eaaacfd7-64c4-4c72-b9be-96362fe34706 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:41.183707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eaaacfd7-64c4-4c72-b9be-96362fe34706 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:41.740546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-eaaacfd7-64c4-4c72-b9be-96362fe34706 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:41.750930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-eaaacfd7-64c4-4c72-b9be-96362fe34706 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.639921 Apr 12 14:54:41.751749 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 16/30] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:41 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:41.756803 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-cd51faea-f7ae-43ee-ba58-006cd1b90a9f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:41.757661 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cd51faea-f7ae-43ee-ba58-006cd1b90a9f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:41.876375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:54:41.877311 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:54:41.877311 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:54:41.877901 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:54:41.878331 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:54:41.915709 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:41.916176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:41.916985 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:41.917429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:42.008178 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Getting quotas for project 566788e9e53f44db92dfad7ee91d6cd2. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:42.016787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-cd51faea-f7ae-43ee-ba58-006cd1b90a9f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:42.023228 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Getting quotas for user fb985e9c053f4c379f14c7ac21fb89bb and project 566788e9e53f44db92dfad7ee91d6cd2. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:42.037727 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-cd51faea-f7ae-43ee-ba58-006cd1b90a9f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1237 microversion: 2.1 time: 0.271221 Apr 12 14:54:42.038594 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 17/31] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:41 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1237 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:42.064116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:54:42.070301 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:54:42.125660 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f53f2913-14de-4527-bf01-611552a4d8d9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:42.126265 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f53f2913-14de-4527-bf01-611552a4d8d9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:42.141448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f53f2913-14de-4527-bf01-611552a4d8d9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:42.146176 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f53f2913-14de-4527-bf01-611552a4d8d9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:42.147590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f53f2913-14de-4527-bf01-611552a4d8d9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:42.148210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f53f2913-14de-4527-bf01-611552a4d8d9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:42.284730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f53f2913-14de-4527-bf01-611552a4d8d9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:42.305424 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f53f2913-14de-4527-bf01-611552a4d8d9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:42.310249 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f53f2913-14de-4527-bf01-611552a4d8d9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:42.311406 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f53f2913-14de-4527-bf01-611552a4d8d9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1286 microversion: 2.20 time: 0.190093 Apr 12 14:54:42.314258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 18/32] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:42 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1286 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:42.453385 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-632ae723-76b8-4feb-8c90-5018193d3367 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.724741 Apr 12 14:54:42.454183 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 15/33] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:54:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:54:42.465421 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-97868e62-2665-44ff-aa5f-a93d592d4004 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:42.466054 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-97868e62-2665-44ff-aa5f-a93d592d4004 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:42.551856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-97868e62-2665-44ff-aa5f-a93d592d4004 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:42.553796 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-97868e62-2665-44ff-aa5f-a93d592d4004 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1222 microversion: 2.1 time: 0.092264 Apr 12 14:54:42.554505 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 19/34] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:42 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:42.778284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c1a769ad-9831-4730-b7ef-265f57c70944 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:42.779529 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c1a769ad-9831-4730-b7ef-265f57c70944 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:42.814727 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1a769ad-9831-4730-b7ef-265f57c70944 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:42.815199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1a769ad-9831-4730-b7ef-265f57c70944 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:42.816009 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1a769ad-9831-4730-b7ef-265f57c70944 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:42.816532 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1a769ad-9831-4730-b7ef-265f57c70944 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:43.062366 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-609d3f7f-49fb-4846-a2fa-2dbe765acf80 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:43.063075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-609d3f7f-49fb-4846-a2fa-2dbe765acf80 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:43.084925 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-609d3f7f-49fb-4846-a2fa-2dbe765acf80 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:43.089663 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-609d3f7f-49fb-4846-a2fa-2dbe765acf80 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:43.090706 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-609d3f7f-49fb-4846-a2fa-2dbe765acf80 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:43.091160 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-609d3f7f-49fb-4846-a2fa-2dbe765acf80 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:43.103367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c1a769ad-9831-4730-b7ef-265f57c70944 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:43.125992 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c1a769ad-9831-4730-b7ef-265f57c70944 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.349013 Apr 12 14:54:43.125992 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 16/35] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:42 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:43.335713 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cf963c8e-379b-4109-8f91-99f4b7884f8d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:43.336362 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cf963c8e-379b-4109-8f91-99f4b7884f8d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:43.369086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf963c8e-379b-4109-8f91-99f4b7884f8d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:43.369838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf963c8e-379b-4109-8f91-99f4b7884f8d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:43.374436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf963c8e-379b-4109-8f91-99f4b7884f8d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:43.374436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf963c8e-379b-4109-8f91-99f4b7884f8d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:43.469774 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-609d3f7f-49fb-4846-a2fa-2dbe765acf80 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:43.492948 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-609d3f7f-49fb-4846-a2fa-2dbe765acf80 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1241 microversion: 2.1 time: 0.434607 Apr 12 14:54:43.497367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 20/36] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:43 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1241 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:43.579975 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c0f29988-b883-428a-b980-54dc87e6ab81 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:43.586074 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c0f29988-b883-428a-b980-54dc87e6ab81 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:43.856791 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cf963c8e-379b-4109-8f91-99f4b7884f8d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:43.865919 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cf963c8e-379b-4109-8f91-99f4b7884f8d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:43.872110 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cf963c8e-379b-4109-8f91-99f4b7884f8d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:43.872110 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cf963c8e-379b-4109-8f91-99f4b7884f8d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1286 microversion: 2.20 time: 0.543682 Apr 12 14:54:43.872110 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 17/37] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:43 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1286 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:43.963848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c0f29988-b883-428a-b980-54dc87e6ab81 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:43.971326 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c0f29988-b883-428a-b980-54dc87e6ab81 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1222 microversion: 2.1 time: 0.397896 Apr 12 14:54:43.981158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 21/38] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:43 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1222 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:44.137738 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a114413e-bcb7-4c27-8627-3081ccdc5717 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:44.139036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a114413e-bcb7-4c27-8627-3081ccdc5717 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:44.145549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a114413e-bcb7-4c27-8627-3081ccdc5717 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:44.146286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a114413e-bcb7-4c27-8627-3081ccdc5717 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:44.147234 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a114413e-bcb7-4c27-8627-3081ccdc5717 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:44.147826 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a114413e-bcb7-4c27-8627-3081ccdc5717 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:44.408271 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a114413e-bcb7-4c27-8627-3081ccdc5717 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:44.417018 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a114413e-bcb7-4c27-8627-3081ccdc5717 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.284287 Apr 12 14:54:44.418280 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 18/39] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:44 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:44.514935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-50ecc4e0-c2f0-4513-9234-634b128fe9b1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:44.515588 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-50ecc4e0-c2f0-4513-9234-634b128fe9b1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:44.521762 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-50ecc4e0-c2f0-4513-9234-634b128fe9b1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:44.522219 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-50ecc4e0-c2f0-4513-9234-634b128fe9b1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:44.522994 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-50ecc4e0-c2f0-4513-9234-634b128fe9b1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:44.523430 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-50ecc4e0-c2f0-4513-9234-634b128fe9b1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:44.625789 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-50ecc4e0-c2f0-4513-9234-634b128fe9b1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:44.637314 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-50ecc4e0-c2f0-4513-9234-634b128fe9b1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1289 microversion: 2.1 time: 0.125931 Apr 12 14:54:44.638706 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 22/40] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:44 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:44.893813 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d66d38fd-8be4-4fdd-b782-5c409b7417b8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:44.893813 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d66d38fd-8be4-4fdd-b782-5c409b7417b8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:44.896268 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d66d38fd-8be4-4fdd-b782-5c409b7417b8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:44.896686 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d66d38fd-8be4-4fdd-b782-5c409b7417b8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:44.897456 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d66d38fd-8be4-4fdd-b782-5c409b7417b8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:44.897926 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d66d38fd-8be4-4fdd-b782-5c409b7417b8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:44.981303 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d66d38fd-8be4-4fdd-b782-5c409b7417b8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:44.990115 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d66d38fd-8be4-4fdd-b782-5c409b7417b8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:44.991623 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d66d38fd-8be4-4fdd-b782-5c409b7417b8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:44.992733 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d66d38fd-8be4-4fdd-b782-5c409b7417b8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1334 microversion: 2.20 time: 0.107525 Apr 12 14:54:44.993555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 19/41] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:44 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:45.000563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0ead551a-14e7-4551-97ef-b367424625ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:45.001534 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0ead551a-14e7-4551-97ef-b367424625ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:45.015652 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0ead551a-14e7-4551-97ef-b367424625ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:45.016218 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0ead551a-14e7-4551-97ef-b367424625ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:45.017508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0ead551a-14e7-4551-97ef-b367424625ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:45.018270 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0ead551a-14e7-4551-97ef-b367424625ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:45.132027 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0ead551a-14e7-4551-97ef-b367424625ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:45.144639 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0ead551a-14e7-4551-97ef-b367424625ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1226 microversion: 2.1 time: 0.147883 Apr 12 14:54:45.146400 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 23/42] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:44 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1226 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:45.435612 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f1c21040-aaa6-4391-b300-bebab2a4aa9b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:45.436111 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f1c21040-aaa6-4391-b300-bebab2a4aa9b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:45.442730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f1c21040-aaa6-4391-b300-bebab2a4aa9b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:45.443388 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f1c21040-aaa6-4391-b300-bebab2a4aa9b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:45.444344 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f1c21040-aaa6-4391-b300-bebab2a4aa9b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:45.444934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f1c21040-aaa6-4391-b300-bebab2a4aa9b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:45.658333 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-215a85ee-999c-4b39-b544-80110115b7de tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:45.659930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-215a85ee-999c-4b39-b544-80110115b7de tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:45.689820 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-215a85ee-999c-4b39-b544-80110115b7de tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:45.691174 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-215a85ee-999c-4b39-b544-80110115b7de tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:45.692247 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-215a85ee-999c-4b39-b544-80110115b7de tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:45.693058 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-215a85ee-999c-4b39-b544-80110115b7de tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:45.758367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f1c21040-aaa6-4391-b300-bebab2a4aa9b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:45.770879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f1c21040-aaa6-4391-b300-bebab2a4aa9b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.340157 Apr 12 14:54:45.771483 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 20/43] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:45 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:45.779304 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-480751322", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc73a003-4067-4844-9c4d-7187574c0c62"}], "security_groups": [{"name": "tempest-securitygroup--1990163957"}], "key_name": "tempest-keypair-1442849917", "user_data": "}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:45.812365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-215a85ee-999c-4b39-b544-80110115b7de tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:45.822052 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-215a85ee-999c-4b39-b544-80110115b7de tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1289 microversion: 2.1 time: 0.169547 Apr 12 14:54:45.822862 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 24/44] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:45 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1289 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:45.909230 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] validate_networks() for [('bc73a003-4067-4844-9c4d-7187574c0c62', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:54:46.015054 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dda3a1d3-d79f-4cb5-8a54-52f246713d75 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:46.018079 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dda3a1d3-d79f-4cb5-8a54-52f246713d75 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:46.027796 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dda3a1d3-d79f-4cb5-8a54-52f246713d75 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:46.030029 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dda3a1d3-d79f-4cb5-8a54-52f246713d75 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:46.031112 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dda3a1d3-d79f-4cb5-8a54-52f246713d75 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:46.032890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dda3a1d3-d79f-4cb5-8a54-52f246713d75 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:46.183020 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dda3a1d3-d79f-4cb5-8a54-52f246713d75 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:46.194384 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dda3a1d3-d79f-4cb5-8a54-52f246713d75 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:46.201128 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dda3a1d3-d79f-4cb5-8a54-52f246713d75 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:46.202611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dda3a1d3-d79f-4cb5-8a54-52f246713d75 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1334 microversion: 2.20 time: 0.194078 Apr 12 14:54:46.203175 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 25/45] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:46 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1334 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:54:46.209323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-cc807397-741a-49c6-ac45-1d5839c7a2c7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:46.214724 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cc807397-741a-49c6-ac45-1d5839c7a2c7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:46.228144 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cc807397-741a-49c6-ac45-1d5839c7a2c7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:46.229066 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cc807397-741a-49c6-ac45-1d5839c7a2c7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:46.230705 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cc807397-741a-49c6-ac45-1d5839c7a2c7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:46.231459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cc807397-741a-49c6-ac45-1d5839c7a2c7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:46.399163 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-cc807397-741a-49c6-ac45-1d5839c7a2c7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:46.409598 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-cc807397-741a-49c6-ac45-1d5839c7a2c7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1274 microversion: 2.1 time: 0.205067 Apr 12 14:54:46.410221 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 26/46] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:46 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1274 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:46.793867 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7b16210d-20ba-48d1-88ff-2b3eb638f12d tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:46.795330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7b16210d-20ba-48d1-88ff-2b3eb638f12d tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:46.815340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b16210d-20ba-48d1-88ff-2b3eb638f12d tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:46.815915 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b16210d-20ba-48d1-88ff-2b3eb638f12d tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:46.819652 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b16210d-20ba-48d1-88ff-2b3eb638f12d tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:46.821190 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b16210d-20ba-48d1-88ff-2b3eb638f12d tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:46.998002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:54:46.998698 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:54:46.998873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:54:47.001145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:54:47.001918 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:54:47.012555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:47.013390 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:47.015264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:47.015993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:47.043622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:54:47.048201 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:54:47.063698 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:54:47.066115 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:54:47.070467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7b16210d-20ba-48d1-88ff-2b3eb638f12d tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:47.079100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7b16210d-20ba-48d1-88ff-2b3eb638f12d tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.291511 Apr 12 14:54:47.087924 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 27/47] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:46 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:47.087924 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-81170079-fe92-472d-a2ac-b2e946dc6d24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:47.087924 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-81170079-fe92-472d-a2ac-b2e946dc6d24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:47.093012 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-81170079-fe92-472d-a2ac-b2e946dc6d24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:47.191806 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-81170079-fe92-472d-a2ac-b2e946dc6d24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:47.191806 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-81170079-fe92-472d-a2ac-b2e946dc6d24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:47.191806 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-81170079-fe92-472d-a2ac-b2e946dc6d24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:47.192577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-81170079-fe92-472d-a2ac-b2e946dc6d24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:47.192577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-81170079-fe92-472d-a2ac-b2e946dc6d24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1295 microversion: 2.1 time: 0.087153 Apr 12 14:54:47.192577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 28/48] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:47 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:47.222721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-594ffc91-7996-4a62-8a9d-b8aa1f388f51 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:47.223477 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-594ffc91-7996-4a62-8a9d-b8aa1f388f51 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:47.235275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-594ffc91-7996-4a62-8a9d-b8aa1f388f51 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:47.235275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-594ffc91-7996-4a62-8a9d-b8aa1f388f51 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:47.235275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-594ffc91-7996-4a62-8a9d-b8aa1f388f51 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:47.235275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-594ffc91-7996-4a62-8a9d-b8aa1f388f51 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:47.303014 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-594ffc91-7996-4a62-8a9d-b8aa1f388f51 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:47.313275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-594ffc91-7996-4a62-8a9d-b8aa1f388f51 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:47.313656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-594ffc91-7996-4a62-8a9d-b8aa1f388f51 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:47.314758 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-594ffc91-7996-4a62-8a9d-b8aa1f388f51 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1342 microversion: 2.20 time: 0.096120 Apr 12 14:54:47.315333 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 29/49] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:47 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1342 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:54:47.434904 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8c52a9b8-8484-445d-8ba8-bcc65c39fa35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:47.435991 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8c52a9b8-8484-445d-8ba8-bcc65c39fa35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:47.443456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c52a9b8-8484-445d-8ba8-bcc65c39fa35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:47.444160 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c52a9b8-8484-445d-8ba8-bcc65c39fa35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:47.445042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c52a9b8-8484-445d-8ba8-bcc65c39fa35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:47.445581 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c52a9b8-8484-445d-8ba8-bcc65c39fa35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:47.525544 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8c52a9b8-8484-445d-8ba8-bcc65c39fa35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:47.533459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8c52a9b8-8484-445d-8ba8-bcc65c39fa35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1282 microversion: 2.1 time: 0.104816 Apr 12 14:54:47.534206 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 30/50] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:47 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:48.097484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dd2978b4-9cc8-45c3-aa09-ab230cc18fcd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:48.098155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dd2978b4-9cc8-45c3-aa09-ab230cc18fcd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:48.105240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd2978b4-9cc8-45c3-aa09-ab230cc18fcd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:48.105753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd2978b4-9cc8-45c3-aa09-ab230cc18fcd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:48.106582 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd2978b4-9cc8-45c3-aa09-ab230cc18fcd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:48.107055 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd2978b4-9cc8-45c3-aa09-ab230cc18fcd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:48.251295 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd2978b4-9cc8-45c3-aa09-ab230cc18fcd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:48.258597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dd2978b4-9cc8-45c3-aa09-ab230cc18fcd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.165371 Apr 12 14:54:48.259160 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 31/51] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:48 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:48.264274 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ae9d268b-03cc-4f0f-936b-4edfc07b01cf tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:48.264882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ae9d268b-03cc-4f0f-936b-4edfc07b01cf tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:48.272010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae9d268b-03cc-4f0f-936b-4edfc07b01cf tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:48.272390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae9d268b-03cc-4f0f-936b-4edfc07b01cf tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:48.273165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae9d268b-03cc-4f0f-936b-4edfc07b01cf tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:48.273593 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae9d268b-03cc-4f0f-936b-4edfc07b01cf tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:48.336476 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ae9d268b-03cc-4f0f-936b-4edfc07b01cf tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:48.344842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ae9d268b-03cc-4f0f-936b-4edfc07b01cf tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1295 microversion: 2.1 time: 0.084617 Apr 12 14:54:48.345442 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 32/52] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:48 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:48.350361 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-43604422-b837-4615-b040-cc293ad131bf tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:48.350969 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-43604422-b837-4615-b040-cc293ad131bf tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:48.358207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43604422-b837-4615-b040-cc293ad131bf tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:48.358590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43604422-b837-4615-b040-cc293ad131bf tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:48.359368 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43604422-b837-4615-b040-cc293ad131bf tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:48.359834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43604422-b837-4615-b040-cc293ad131bf tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:48.381798 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a8d1b7aa-4c26-4ad5-bea8-95a5429da90c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.608961 Apr 12 14:54:48.382574 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 21/53] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:54:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 2610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:54:48.394555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3e7c6d44-9a62-4a0f-9387-40164a8dc5f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:48.395753 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3e7c6d44-9a62-4a0f-9387-40164a8dc5f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:48.480572 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-43604422-b837-4615-b040-cc293ad131bf tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:48.500548 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3e7c6d44-9a62-4a0f-9387-40164a8dc5f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:48.509135 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3e7c6d44-9a62-4a0f-9387-40164a8dc5f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1241 microversion: 2.1 time: 0.119003 Apr 12 14:54:48.509756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 22/54] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:48 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:48.514142 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-43604422-b837-4615-b040-cc293ad131bf tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:48.515932 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-43604422-b837-4615-b040-cc293ad131bf tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:48.518930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-43604422-b837-4615-b040-cc293ad131bf tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1342 microversion: 2.20 time: 0.170993 Apr 12 14:54:48.534769 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 33/55] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:48 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:48.551284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0f526205-cd60-448e-b98f-3dec119b605a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:48.551989 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0f526205-cd60-448e-b98f-3dec119b605a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:48.561195 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f526205-cd60-448e-b98f-3dec119b605a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:48.563033 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f526205-cd60-448e-b98f-3dec119b605a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:48.565574 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f526205-cd60-448e-b98f-3dec119b605a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:48.566604 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f526205-cd60-448e-b98f-3dec119b605a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:48.729551 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0f526205-cd60-448e-b98f-3dec119b605a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:48.738544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0f526205-cd60-448e-b98f-3dec119b605a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1282 microversion: 2.1 time: 0.191164 Apr 12 14:54:48.739599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 23/56] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:48 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:49.281650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5ec496b7-af98-417e-8767-d613a6740a17 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:49.281650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5ec496b7-af98-417e-8767-d613a6740a17 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:49.285842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ec496b7-af98-417e-8767-d613a6740a17 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:49.286426 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ec496b7-af98-417e-8767-d613a6740a17 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:49.287406 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ec496b7-af98-417e-8767-d613a6740a17 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:49.287841 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ec496b7-af98-417e-8767-d613a6740a17 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:49.368100 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8e413466-1215-4366-8d0c-5ac3b4f7da00 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:49.370428 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8e413466-1215-4366-8d0c-5ac3b4f7da00 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:49.379750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e413466-1215-4366-8d0c-5ac3b4f7da00 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:49.380749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e413466-1215-4366-8d0c-5ac3b4f7da00 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:49.381842 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e413466-1215-4366-8d0c-5ac3b4f7da00 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:49.382607 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e413466-1215-4366-8d0c-5ac3b4f7da00 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:49.480638 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5ec496b7-af98-417e-8767-d613a6740a17 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:49.492993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5ec496b7-af98-417e-8767-d613a6740a17 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.218426 Apr 12 14:54:49.494189 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 34/57] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:49 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:49.528296 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a1fe8b90-1410-46d6-a828-51fed6034909 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:49.529226 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a1fe8b90-1410-46d6-a828-51fed6034909 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:49.700115 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a1fe8b90-1410-46d6-a828-51fed6034909 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:49.708377 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a1fe8b90-1410-46d6-a828-51fed6034909 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1241 microversion: 2.1 time: 0.186061 Apr 12 14:54:49.709350 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 35/58] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:49 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:49.733293 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1ebb32f3-3571-4ce9-bad1-74ba72a28a86 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:49.753231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8e413466-1215-4366-8d0c-5ac3b4f7da00 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:49.778316 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1ebb32f3-3571-4ce9-bad1-74ba72a28a86 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:49.782252 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8e413466-1215-4366-8d0c-5ac3b4f7da00 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.415459 Apr 12 14:54:49.804770 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 24/59] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:49 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:49.806849 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1ebb32f3-3571-4ce9-bad1-74ba72a28a86 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:49.807350 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1ebb32f3-3571-4ce9-bad1-74ba72a28a86 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:49.808860 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1ebb32f3-3571-4ce9-bad1-74ba72a28a86 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:49.809315 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1ebb32f3-3571-4ce9-bad1-74ba72a28a86 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:49.810453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7ea06357-8495-4f5a-9712-c4d7bec78150 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:49.812193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7ea06357-8495-4f5a-9712-c4d7bec78150 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:49.823284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ea06357-8495-4f5a-9712-c4d7bec78150 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:49.824157 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ea06357-8495-4f5a-9712-c4d7bec78150 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:49.825764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ea06357-8495-4f5a-9712-c4d7bec78150 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:49.826396 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ea06357-8495-4f5a-9712-c4d7bec78150 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:50.041449 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1ebb32f3-3571-4ce9-bad1-74ba72a28a86 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:50.063227 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1ebb32f3-3571-4ce9-bad1-74ba72a28a86 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:50.066848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1ebb32f3-3571-4ce9-bad1-74ba72a28a86 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:50.068045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1ebb32f3-3571-4ce9-bad1-74ba72a28a86 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1340 microversion: 2.20 time: 0.357697 Apr 12 14:54:50.083360 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 36/60] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:49 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1340 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:50.165746 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7ea06357-8495-4f5a-9712-c4d7bec78150 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:50.181593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7ea06357-8495-4f5a-9712-c4d7bec78150 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1282 microversion: 2.1 time: 0.375304 Apr 12 14:54:50.183634 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 25/61] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:49 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1282 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:50.520383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-aa4994ac-58a2-46f5-99d8-c0a33fc7fa11 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:50.521189 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-aa4994ac-58a2-46f5-99d8-c0a33fc7fa11 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:50.559325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa4994ac-58a2-46f5-99d8-c0a33fc7fa11 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:50.560366 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa4994ac-58a2-46f5-99d8-c0a33fc7fa11 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:50.561311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa4994ac-58a2-46f5-99d8-c0a33fc7fa11 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:50.561917 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa4994ac-58a2-46f5-99d8-c0a33fc7fa11 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:50.727865 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c4b2d816-99a1-4fdd-8544-89aaeb9ab280 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:50.739287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c4b2d816-99a1-4fdd-8544-89aaeb9ab280 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:50.774024 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4b2d816-99a1-4fdd-8544-89aaeb9ab280 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:50.777364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4b2d816-99a1-4fdd-8544-89aaeb9ab280 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:50.779359 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4b2d816-99a1-4fdd-8544-89aaeb9ab280 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:50.788315 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4b2d816-99a1-4fdd-8544-89aaeb9ab280 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:50.863776 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-aa4994ac-58a2-46f5-99d8-c0a33fc7fa11 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:50.875412 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-aa4994ac-58a2-46f5-99d8-c0a33fc7fa11 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.360172 Apr 12 14:54:50.876687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 37/62] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:50 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:50.890109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3ddae062-37ee-4bfc-826d-e76d30808b65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:50.891175 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3ddae062-37ee-4bfc-826d-e76d30808b65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:50.911632 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3ddae062-37ee-4bfc-826d-e76d30808b65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:50.912095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3ddae062-37ee-4bfc-826d-e76d30808b65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:50.912897 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3ddae062-37ee-4bfc-826d-e76d30808b65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:50.913333 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3ddae062-37ee-4bfc-826d-e76d30808b65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:50.920468 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c4b2d816-99a1-4fdd-8544-89aaeb9ab280 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:50.929558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c4b2d816-99a1-4fdd-8544-89aaeb9ab280 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1293 microversion: 2.1 time: 0.207633 Apr 12 14:54:50.932396 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 26/63] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:50 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1293 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:51.098005 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0eb0e3e0-479b-49af-9851-e61f43e1b76c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:51.098656 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0eb0e3e0-479b-49af-9851-e61f43e1b76c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:51.105819 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0eb0e3e0-479b-49af-9851-e61f43e1b76c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:51.106308 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0eb0e3e0-479b-49af-9851-e61f43e1b76c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:51.110174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0eb0e3e0-479b-49af-9851-e61f43e1b76c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:51.112194 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0eb0e3e0-479b-49af-9851-e61f43e1b76c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:51.326453 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3ddae062-37ee-4bfc-826d-e76d30808b65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:51.345896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3ddae062-37ee-4bfc-826d-e76d30808b65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.467713 Apr 12 14:54:51.346775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 38/64] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:50 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:51.352202 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-912e3033-d466-47ce-b713-8b403760b69c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:51.352202 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-912e3033-d466-47ce-b713-8b403760b69c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:51.359579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-912e3033-d466-47ce-b713-8b403760b69c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:51.360038 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-912e3033-d466-47ce-b713-8b403760b69c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:51.360831 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-912e3033-d466-47ce-b713-8b403760b69c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:51.361262 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-912e3033-d466-47ce-b713-8b403760b69c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:51.531812 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0eb0e3e0-479b-49af-9851-e61f43e1b76c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:51.542823 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0eb0e3e0-479b-49af-9851-e61f43e1b76c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:51.544475 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0eb0e3e0-479b-49af-9851-e61f43e1b76c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:51.545655 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0eb0e3e0-479b-49af-9851-e61f43e1b76c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.454198 Apr 12 14:54:51.546859 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 27/65] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:51 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:54:51.547870 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-912e3033-d466-47ce-b713-8b403760b69c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:51.564236 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-912e3033-d466-47ce-b713-8b403760b69c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1280 microversion: 2.1 time: 0.212325 Apr 12 14:54:51.567794 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 39/66] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:51 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:51.895779 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3cdbfc00-054d-48b9-bf97-aa961ef34fb4 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:51.896453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3cdbfc00-054d-48b9-bf97-aa961ef34fb4 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:51.911451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3cdbfc00-054d-48b9-bf97-aa961ef34fb4 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:51.912758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3cdbfc00-054d-48b9-bf97-aa961ef34fb4 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:51.914429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3cdbfc00-054d-48b9-bf97-aa961ef34fb4 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:51.915281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3cdbfc00-054d-48b9-bf97-aa961ef34fb4 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:51.951699 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3536ea58-3b8d-45e5-b721-acc161b24e27 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:51.952797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3536ea58-3b8d-45e5-b721-acc161b24e27 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:51.972252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3536ea58-3b8d-45e5-b721-acc161b24e27 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:51.973229 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3536ea58-3b8d-45e5-b721-acc161b24e27 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:51.974412 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3536ea58-3b8d-45e5-b721-acc161b24e27 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:51.984488 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3536ea58-3b8d-45e5-b721-acc161b24e27 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:52.177406 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3536ea58-3b8d-45e5-b721-acc161b24e27 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:52.190081 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3536ea58-3b8d-45e5-b721-acc161b24e27 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1311 microversion: 2.1 time: 0.243633 Apr 12 14:54:52.200840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 40/67] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:51 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1311 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:52.368770 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-96e3e673-ad37-4196-ad4d-41236b891d34 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:52.369297 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-96e3e673-ad37-4196-ad4d-41236b891d34 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:52.385043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-96e3e673-ad37-4196-ad4d-41236b891d34 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:52.391146 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-96e3e673-ad37-4196-ad4d-41236b891d34 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:52.392216 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-96e3e673-ad37-4196-ad4d-41236b891d34 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:52.392655 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-96e3e673-ad37-4196-ad4d-41236b891d34 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:52.445145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3cdbfc00-054d-48b9-bf97-aa961ef34fb4 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:52.483240 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3cdbfc00-054d-48b9-bf97-aa961ef34fb4 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.590903 Apr 12 14:54:52.504533 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 28/68] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:51 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:52.654006 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-fb562695-df00-49e2-82dd-1ec28ad37f78 req-f098a5fd-a5d1-44b1-a36e-101e0b179fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d708580-277c-46d3-9972-57055255f9b9", "name": "network-vif-plugged", "status": "completed", "tag": "9f9def6f-5f72-486a-9964-ccea9979c6f0"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:52.681900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-fb562695-df00-49e2-82dd-1ec28ad37f78 req-f098a5fd-a5d1-44b1-a36e-101e0b179fd8 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:52.681900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-fb562695-df00-49e2-82dd-1ec28ad37f78 req-f098a5fd-a5d1-44b1-a36e-101e0b179fd8 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:52.710065 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-fb562695-df00-49e2-82dd-1ec28ad37f78 req-f098a5fd-a5d1-44b1-a36e-101e0b179fd8 service nova] Creating event network-vif-plugged:9f9def6f-5f72-486a-9964-ccea9979c6f0 for instance 1d708580-277c-46d3-9972-57055255f9b9 on hv-cinder-83752 Apr 12 14:54:52.720113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-fb562695-df00-49e2-82dd-1ec28ad37f78 req-f098a5fd-a5d1-44b1-a36e-101e0b179fd8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210248 Apr 12 14:54:52.725669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 29/69] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:54:52.733193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ab5e4110-da66-4167-83de-d9b6d20cbde9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:52.734131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ab5e4110-da66-4167-83de-d9b6d20cbde9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:52.742463 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab5e4110-da66-4167-83de-d9b6d20cbde9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:52.742923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab5e4110-da66-4167-83de-d9b6d20cbde9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:52.743897 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab5e4110-da66-4167-83de-d9b6d20cbde9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:52.744338 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab5e4110-da66-4167-83de-d9b6d20cbde9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:52.772611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-96e3e673-ad37-4196-ad4d-41236b891d34 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:52.788596 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-96e3e673-ad37-4196-ad4d-41236b891d34 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.421511 Apr 12 14:54:52.789277 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 41/70] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:52 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:52.812424 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9d579380-b6be-4664-af29-68f77cc64c35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:52.813048 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9d579380-b6be-4664-af29-68f77cc64c35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:52.825612 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d579380-b6be-4664-af29-68f77cc64c35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:52.825923 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d579380-b6be-4664-af29-68f77cc64c35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:52.826716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d579380-b6be-4664-af29-68f77cc64c35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:52.836536 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d579380-b6be-4664-af29-68f77cc64c35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:52.953366 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9d579380-b6be-4664-af29-68f77cc64c35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:52.965994 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9d579380-b6be-4664-af29-68f77cc64c35 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1280 microversion: 2.1 time: 0.162534 Apr 12 14:54:52.967083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 42/71] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:52 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1280 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:53.048549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ab5e4110-da66-4167-83de-d9b6d20cbde9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:53.056688 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ab5e4110-da66-4167-83de-d9b6d20cbde9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:53.058938 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ab5e4110-da66-4167-83de-d9b6d20cbde9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:53.060025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ab5e4110-da66-4167-83de-d9b6d20cbde9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.333015 Apr 12 14:54:53.060583 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 30/72] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:52 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:53.221822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3a2bc7d3-3aef-4abb-96fd-4f05d8d498b0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:53.222912 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3a2bc7d3-3aef-4abb-96fd-4f05d8d498b0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:53.236474 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-aef1f610-67fe-45fc-a18e-d3a87bb02541 req-ce8440a5-19f1-405b-b7b3-30e49f328942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d03f42e-2d51-459d-ade0-7e6a34283867", "tag": "90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:53.238001 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a2bc7d3-3aef-4abb-96fd-4f05d8d498b0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:53.241477 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a2bc7d3-3aef-4abb-96fd-4f05d8d498b0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:53.241477 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a2bc7d3-3aef-4abb-96fd-4f05d8d498b0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:53.241477 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a2bc7d3-3aef-4abb-96fd-4f05d8d498b0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:53.256593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-aef1f610-67fe-45fc-a18e-d3a87bb02541 req-ce8440a5-19f1-405b-b7b3-30e49f328942 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:53.258221 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-aef1f610-67fe-45fc-a18e-d3a87bb02541 req-ce8440a5-19f1-405b-b7b3-30e49f328942 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:53.287757 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-aef1f610-67fe-45fc-a18e-d3a87bb02541 req-ce8440a5-19f1-405b-b7b3-30e49f328942 service nova] Creating event network-changed:90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77 for instance 9d03f42e-2d51-459d-ade0-7e6a34283867 on hv-cinder-83752 Apr 12 14:54:53.322264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-aef1f610-67fe-45fc-a18e-d3a87bb02541 req-ce8440a5-19f1-405b-b7b3-30e49f328942 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090247 Apr 12 14:54:53.327509 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 31/73] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:54:53.452671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3a2bc7d3-3aef-4abb-96fd-4f05d8d498b0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:53.469006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3a2bc7d3-3aef-4abb-96fd-4f05d8d498b0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1299 microversion: 2.1 time: 0.263252 Apr 12 14:54:53.470545 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 43/74] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:53 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:53.516479 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a316cac0-a542-4406-a614-bdb954b2a590 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:53.517181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a316cac0-a542-4406-a614-bdb954b2a590 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:53.528537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a316cac0-a542-4406-a614-bdb954b2a590 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:53.529232 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a316cac0-a542-4406-a614-bdb954b2a590 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:53.534854 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a316cac0-a542-4406-a614-bdb954b2a590 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:53.545949 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a316cac0-a542-4406-a614-bdb954b2a590 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:53.809102 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-562341ea-f79f-4ffa-bde2-a71228d2200b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:53.810625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-562341ea-f79f-4ffa-bde2-a71228d2200b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:53.828508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-562341ea-f79f-4ffa-bde2-a71228d2200b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:53.828980 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-562341ea-f79f-4ffa-bde2-a71228d2200b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:53.831316 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-562341ea-f79f-4ffa-bde2-a71228d2200b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:53.834819 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-562341ea-f79f-4ffa-bde2-a71228d2200b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:54.247564 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a316cac0-a542-4406-a614-bdb954b2a590 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:54.258717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a316cac0-a542-4406-a614-bdb954b2a590 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.746373 Apr 12 14:54:54.259332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 32/75] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:53 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:54.268838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0c91a36d-94ee-4955-90b7-73b98f45938a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:54.268838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0c91a36d-94ee-4955-90b7-73b98f45938a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:54.284060 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c91a36d-94ee-4955-90b7-73b98f45938a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:54.284514 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c91a36d-94ee-4955-90b7-73b98f45938a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:54.287687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c91a36d-94ee-4955-90b7-73b98f45938a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:54.291029 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c91a36d-94ee-4955-90b7-73b98f45938a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:54.327876 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-562341ea-f79f-4ffa-bde2-a71228d2200b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:54.345583 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-562341ea-f79f-4ffa-bde2-a71228d2200b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.542237 Apr 12 14:54:54.348692 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 44/76] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:53 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:54.506061 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0c91a36d-94ee-4955-90b7-73b98f45938a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:54.513989 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0c91a36d-94ee-4955-90b7-73b98f45938a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.253585 Apr 12 14:54:54.514748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 33/77] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:54 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:54.520281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1f26a0db-2140-4a6f-94b9-d060613c7f05 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:54.521080 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1f26a0db-2140-4a6f-94b9-d060613c7f05 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:54.530765 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f26a0db-2140-4a6f-94b9-d060613c7f05 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:54.530765 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f26a0db-2140-4a6f-94b9-d060613c7f05 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:54.531176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f26a0db-2140-4a6f-94b9-d060613c7f05 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:54.531669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f26a0db-2140-4a6f-94b9-d060613c7f05 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:54.576379 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-cccf54ef-6c6b-4912-84aa-5be9938108e4 req-01a9cee6-833f-4d12-94de-a6913952c843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc3e6773-eb1f-4098-b443-1b2d62d1abe8", "tag": "7448f465-5339-4bd1-91a9-94095a601931"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:54.590015 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-cccf54ef-6c6b-4912-84aa-5be9938108e4 req-01a9cee6-833f-4d12-94de-a6913952c843 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:54.590643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-cccf54ef-6c6b-4912-84aa-5be9938108e4 req-01a9cee6-833f-4d12-94de-a6913952c843 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:54.612588 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-cccf54ef-6c6b-4912-84aa-5be9938108e4 req-01a9cee6-833f-4d12-94de-a6913952c843 service nova] Creating event network-changed:7448f465-5339-4bd1-91a9-94095a601931 for instance cc3e6773-eb1f-4098-b443-1b2d62d1abe8 on hv-cinder-83752 Apr 12 14:54:54.613106 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-cccf54ef-6c6b-4912-84aa-5be9938108e4 req-01a9cee6-833f-4d12-94de-a6913952c843 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 12 14:54:54.616314 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62423acc-d7bf-4ca3-a456-ef24c9ce0d73 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:54.616314 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62423acc-d7bf-4ca3-a456-ef24c9ce0d73 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:54.616314 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62423acc-d7bf-4ca3-a456-ef24c9ce0d73 None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:54.616814 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62423acc-d7bf-4ca3-a456-ef24c9ce0d73 None None] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:54.631098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.compute.rpcapi [None req-62423acc-d7bf-4ca3-a456-ef24c9ce0d73 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 12 14:54:54.631098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62423acc-d7bf-4ca3-a456-ef24c9ce0d73 None None] Releasing lock "compute-rpcapi-router" {{(pid=124198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 14:54:54.647721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-62423acc-d7bf-4ca3-a456-ef24c9ce0d73 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297611 Apr 12 14:54:54.648437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 45/78] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:54:54.655563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4427402f-7c53-4e50-ac67-3f2803ce7c3b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:54.656295 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4427402f-7c53-4e50-ac67-3f2803ce7c3b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:54.662700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4427402f-7c53-4e50-ac67-3f2803ce7c3b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:54.663152 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4427402f-7c53-4e50-ac67-3f2803ce7c3b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:54.663941 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4427402f-7c53-4e50-ac67-3f2803ce7c3b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:54.664375 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4427402f-7c53-4e50-ac67-3f2803ce7c3b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:54.690581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1f26a0db-2140-4a6f-94b9-d060613c7f05 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:54.704439 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1f26a0db-2140-4a6f-94b9-d060613c7f05 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:54.707660 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1f26a0db-2140-4a6f-94b9-d060613c7f05 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:54.720029 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1f26a0db-2140-4a6f-94b9-d060613c7f05 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.193231 Apr 12 14:54:54.720029 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 34/79] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:54 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:54.824179 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4427402f-7c53-4e50-ac67-3f2803ce7c3b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:54.833414 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4427402f-7c53-4e50-ac67-3f2803ce7c3b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.183655 Apr 12 14:54:54.843264 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 46/80] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:54 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:55.276997 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-412c79a6-c45c-48a9-9686-b82e3174a31f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:55.279789 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-412c79a6-c45c-48a9-9686-b82e3174a31f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:55.283818 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-412c79a6-c45c-48a9-9686-b82e3174a31f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:55.284266 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-412c79a6-c45c-48a9-9686-b82e3174a31f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:55.285093 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-412c79a6-c45c-48a9-9686-b82e3174a31f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:55.285525 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-412c79a6-c45c-48a9-9686-b82e3174a31f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:55.365788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-aa8f2532-46f3-4d75-b2f1-4509683f9d45 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:55.366386 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-aa8f2532-46f3-4d75-b2f1-4509683f9d45 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:55.373821 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa8f2532-46f3-4d75-b2f1-4509683f9d45 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:55.374263 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa8f2532-46f3-4d75-b2f1-4509683f9d45 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:55.375035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa8f2532-46f3-4d75-b2f1-4509683f9d45 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:55.375464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa8f2532-46f3-4d75-b2f1-4509683f9d45 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:55.429991 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-412c79a6-c45c-48a9-9686-b82e3174a31f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:55.438470 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-412c79a6-c45c-48a9-9686-b82e3174a31f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.165955 Apr 12 14:54:55.439062 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 35/81] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:55 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:55.522055 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-aa8f2532-46f3-4d75-b2f1-4509683f9d45 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:55.532831 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-52884d6a-486f-427c-bf23-517ec469c6ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:55.533543 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-52884d6a-486f-427c-bf23-517ec469c6ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:55.537585 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-aa8f2532-46f3-4d75-b2f1-4509683f9d45 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.170178 Apr 12 14:54:55.537585 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 47/82] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:55 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:55.541330 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52884d6a-486f-427c-bf23-517ec469c6ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:55.542748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52884d6a-486f-427c-bf23-517ec469c6ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:55.543682 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52884d6a-486f-427c-bf23-517ec469c6ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:55.544128 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52884d6a-486f-427c-bf23-517ec469c6ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:55.686540 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-52884d6a-486f-427c-bf23-517ec469c6ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:55.694160 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-52884d6a-486f-427c-bf23-517ec469c6ba tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.166285 Apr 12 14:54:55.694731 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 36/83] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:55 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:55.728499 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9054f6dc-c000-4161-8824-fd7e069574b1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:55.730364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9054f6dc-c000-4161-8824-fd7e069574b1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:55.736419 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9054f6dc-c000-4161-8824-fd7e069574b1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:55.736866 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9054f6dc-c000-4161-8824-fd7e069574b1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:55.737625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9054f6dc-c000-4161-8824-fd7e069574b1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:55.738272 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9054f6dc-c000-4161-8824-fd7e069574b1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:55.850982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dbb20331-6acc-4d22-88ea-888f6f458714 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:55.851849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dbb20331-6acc-4d22-88ea-888f6f458714 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:55.858199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbb20331-6acc-4d22-88ea-888f6f458714 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:55.858891 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbb20331-6acc-4d22-88ea-888f6f458714 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:55.859879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbb20331-6acc-4d22-88ea-888f6f458714 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:55.860311 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbb20331-6acc-4d22-88ea-888f6f458714 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:55.893293 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9054f6dc-c000-4161-8824-fd7e069574b1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:55.901852 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9054f6dc-c000-4161-8824-fd7e069574b1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:55.903383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9054f6dc-c000-4161-8824-fd7e069574b1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:55.904516 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9054f6dc-c000-4161-8824-fd7e069574b1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.180200 Apr 12 14:54:55.905091 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 48/84] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:55 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:55.999103 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dbb20331-6acc-4d22-88ea-888f6f458714 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:56.006559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dbb20331-6acc-4d22-88ea-888f6f458714 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.159444 Apr 12 14:54:56.007133 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 37/85] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:55 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:56.456353 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d4fa87b1-09c3-44ae-b2a6-03d6c72c722a tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:56.457851 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d4fa87b1-09c3-44ae-b2a6-03d6c72c722a tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:56.463643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4fa87b1-09c3-44ae-b2a6-03d6c72c722a tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:56.464124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4fa87b1-09c3-44ae-b2a6-03d6c72c722a tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:56.464985 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4fa87b1-09c3-44ae-b2a6-03d6c72c722a tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:56.465415 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4fa87b1-09c3-44ae-b2a6-03d6c72c722a tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:56.559227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2a7aea40-18c3-4838-a7e5-b781b965ecb9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:56.559227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2a7aea40-18c3-4838-a7e5-b781b965ecb9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:56.564117 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a7aea40-18c3-4838-a7e5-b781b965ecb9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:56.564561 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a7aea40-18c3-4838-a7e5-b781b965ecb9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:56.565379 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a7aea40-18c3-4838-a7e5-b781b965ecb9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:56.566036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a7aea40-18c3-4838-a7e5-b781b965ecb9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:56.628444 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d4fa87b1-09c3-44ae-b2a6-03d6c72c722a tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:56.637070 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d4fa87b1-09c3-44ae-b2a6-03d6c72c722a tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.184624 Apr 12 14:54:56.637763 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 49/86] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:56 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:56.667609 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-843afef3-09ed-4603-b3c1-2f94ce02627b req-541437bf-a0e6-4802-b9c8-7240a660a77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e6b586-ce02-4394-a2a1-6ae5e0f09306", "tag": "f7b6eb0e-0b23-4a4b-81d8-d386bce95c9e"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:56.683953 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-843afef3-09ed-4603-b3c1-2f94ce02627b req-541437bf-a0e6-4802-b9c8-7240a660a77e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:56.684723 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-843afef3-09ed-4603-b3c1-2f94ce02627b req-541437bf-a0e6-4802-b9c8-7240a660a77e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:56.703757 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-843afef3-09ed-4603-b3c1-2f94ce02627b req-541437bf-a0e6-4802-b9c8-7240a660a77e service nova] Creating event network-changed:f7b6eb0e-0b23-4a4b-81d8-d386bce95c9e for instance 92e6b586-ce02-4394-a2a1-6ae5e0f09306 on hv-cinder-83752 Apr 12 14:54:56.712126 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-843afef3-09ed-4603-b3c1-2f94ce02627b req-541437bf-a0e6-4802-b9c8-7240a660a77e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051005 Apr 12 14:54:56.713247 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 50/87] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:54:56.720301 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2a7aea40-18c3-4838-a7e5-b781b965ecb9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:56.724905 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4d81c3a6-dfb6-45ea-a402-19c0360aa8b9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:56.724905 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4d81c3a6-dfb6-45ea-a402-19c0360aa8b9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:56.728036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2a7aea40-18c3-4838-a7e5-b781b965ecb9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.176176 Apr 12 14:54:56.728614 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 38/88] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:56 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:56.732022 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4d81c3a6-dfb6-45ea-a402-19c0360aa8b9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:56.732460 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4d81c3a6-dfb6-45ea-a402-19c0360aa8b9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:56.733406 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4d81c3a6-dfb6-45ea-a402-19c0360aa8b9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:56.733875 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4d81c3a6-dfb6-45ea-a402-19c0360aa8b9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:56.881217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4d81c3a6-dfb6-45ea-a402-19c0360aa8b9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:56.892124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4d81c3a6-dfb6-45ea-a402-19c0360aa8b9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.176926 Apr 12 14:54:56.892716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 51/89] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:56 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:56.924139 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-632a0e44-08ad-4e40-9280-3b07486f699d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:56.924640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-632a0e44-08ad-4e40-9280-3b07486f699d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:56.930524 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-632a0e44-08ad-4e40-9280-3b07486f699d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:56.931010 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-632a0e44-08ad-4e40-9280-3b07486f699d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:56.931768 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-632a0e44-08ad-4e40-9280-3b07486f699d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:56.933584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-632a0e44-08ad-4e40-9280-3b07486f699d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:57.025055 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3e2c27e9-4333-4acb-b6e5-03d783a157ba tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:57.026546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3e2c27e9-4333-4acb-b6e5-03d783a157ba tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:57.034252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e2c27e9-4333-4acb-b6e5-03d783a157ba tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:57.034700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e2c27e9-4333-4acb-b6e5-03d783a157ba tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:57.035475 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e2c27e9-4333-4acb-b6e5-03d783a157ba tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:57.035904 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e2c27e9-4333-4acb-b6e5-03d783a157ba tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:57.280168 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-632a0e44-08ad-4e40-9280-3b07486f699d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:57.289709 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-632a0e44-08ad-4e40-9280-3b07486f699d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:57.292593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-632a0e44-08ad-4e40-9280-3b07486f699d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:57.293867 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-632a0e44-08ad-4e40-9280-3b07486f699d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.373713 Apr 12 14:54:57.294870 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 39/90] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:56 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:57.342376 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3e2c27e9-4333-4acb-b6e5-03d783a157ba tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:57.350156 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3e2c27e9-4333-4acb-b6e5-03d783a157ba tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.329157 Apr 12 14:54:57.350817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 52/91] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:57 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:57.656574 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-63a67634-a078-4082-a771-9ee0758794d8 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:57.657217 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-63a67634-a078-4082-a771-9ee0758794d8 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:57.663651 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63a67634-a078-4082-a771-9ee0758794d8 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:57.664246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63a67634-a078-4082-a771-9ee0758794d8 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:57.665034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63a67634-a078-4082-a771-9ee0758794d8 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:57.665501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63a67634-a078-4082-a771-9ee0758794d8 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:57.748419 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9c26064a-c4ca-4d1b-9edb-0222ce60327c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:57.749108 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9c26064a-c4ca-4d1b-9edb-0222ce60327c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:57.760949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c26064a-c4ca-4d1b-9edb-0222ce60327c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:57.761386 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c26064a-c4ca-4d1b-9edb-0222ce60327c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:57.762406 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c26064a-c4ca-4d1b-9edb-0222ce60327c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:57.762842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c26064a-c4ca-4d1b-9edb-0222ce60327c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:57.819757 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-63a67634-a078-4082-a771-9ee0758794d8 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:57.828544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-63a67634-a078-4082-a771-9ee0758794d8 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.177330 Apr 12 14:54:57.829132 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 40/92] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:57 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:57.909433 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e977b674-1e21-4b10-bee1-c8350d0ff8e5 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:57.910767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e977b674-1e21-4b10-bee1-c8350d0ff8e5 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:57.917177 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9c26064a-c4ca-4d1b-9edb-0222ce60327c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:57.918735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e977b674-1e21-4b10-bee1-c8350d0ff8e5 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:57.925353 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e977b674-1e21-4b10-bee1-c8350d0ff8e5 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:57.925353 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e977b674-1e21-4b10-bee1-c8350d0ff8e5 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:57.925353 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e977b674-1e21-4b10-bee1-c8350d0ff8e5 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:57.926392 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9c26064a-c4ca-4d1b-9edb-0222ce60327c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.182680 Apr 12 14:54:57.926989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 53/93] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:57 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:54:58.065691 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e977b674-1e21-4b10-bee1-c8350d0ff8e5 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:58.073679 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e977b674-1e21-4b10-bee1-c8350d0ff8e5 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.168669 Apr 12 14:54:58.074253 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 41/94] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:57 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:58.316818 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-632e61c6-1dd3-40f6-bd21-2234c4459ddd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:58.318542 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-632e61c6-1dd3-40f6-bd21-2234c4459ddd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:58.331329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-632e61c6-1dd3-40f6-bd21-2234c4459ddd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:58.332660 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-632e61c6-1dd3-40f6-bd21-2234c4459ddd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:58.334768 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-632e61c6-1dd3-40f6-bd21-2234c4459ddd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:58.335696 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-632e61c6-1dd3-40f6-bd21-2234c4459ddd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:58.368464 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-32e6318d-b002-4f2e-939a-405087185bcc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:58.370187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-32e6318d-b002-4f2e-939a-405087185bcc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:58.380752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-32e6318d-b002-4f2e-939a-405087185bcc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:58.382275 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-32e6318d-b002-4f2e-939a-405087185bcc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:58.390629 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-32e6318d-b002-4f2e-939a-405087185bcc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:58.391990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-32e6318d-b002-4f2e-939a-405087185bcc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:58.574054 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-632e61c6-1dd3-40f6-bd21-2234c4459ddd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:58.585661 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-32e6318d-b002-4f2e-939a-405087185bcc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:58.586375 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-632e61c6-1dd3-40f6-bd21-2234c4459ddd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:58.599740 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-632e61c6-1dd3-40f6-bd21-2234c4459ddd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:58.601132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-632e61c6-1dd3-40f6-bd21-2234c4459ddd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.291482 Apr 12 14:54:58.602470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 54/95] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:58 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:58.611843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-32e6318d-b002-4f2e-939a-405087185bcc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.247287 Apr 12 14:54:58.612444 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 42/96] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:58 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:58.735362 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-4e176aaa-78ec-4fbf-9666-bfdd76ca3e50 req-ceb841e3-0b64-41fd-871b-38b27dc4e378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71207994-1780-4e45-b693-8455d8038f21", "tag": "5d8aa5a2-fd7c-4d6a-b44f-15e67a9087c0"}, {"name": "network-changed", "server_uuid": "e2e10895-454d-437b-9325-591ccaa80da9", "tag": "83c56c7d-fadb-4e42-871f-2399e0153f94"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:54:58.749144 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-4e176aaa-78ec-4fbf-9666-bfdd76ca3e50 req-ceb841e3-0b64-41fd-871b-38b27dc4e378 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:58.749910 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-4e176aaa-78ec-4fbf-9666-bfdd76ca3e50 req-ceb841e3-0b64-41fd-871b-38b27dc4e378 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:58.784939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-4e176aaa-78ec-4fbf-9666-bfdd76ca3e50 req-ceb841e3-0b64-41fd-871b-38b27dc4e378 service nova] Creating event network-changed:5d8aa5a2-fd7c-4d6a-b44f-15e67a9087c0 for instance 71207994-1780-4e45-b693-8455d8038f21 on hv-cinder-83752 Apr 12 14:54:58.785923 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-4e176aaa-78ec-4fbf-9666-bfdd76ca3e50 req-ceb841e3-0b64-41fd-871b-38b27dc4e378 service nova] Creating event network-changed:83c56c7d-fadb-4e42-871f-2399e0153f94 for instance e2e10895-454d-437b-9325-591ccaa80da9 on hv-cinder-83752 Apr 12 14:54:58.794990 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-4e176aaa-78ec-4fbf-9666-bfdd76ca3e50 req-ceb841e3-0b64-41fd-871b-38b27dc4e378 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062678 Apr 12 14:54:58.795807 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 55/97] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:54:58.849210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cd5703ee-14c9-4a3d-8806-b0f63b137481 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:58.849210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cd5703ee-14c9-4a3d-8806-b0f63b137481 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:58.855187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd5703ee-14c9-4a3d-8806-b0f63b137481 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:58.855837 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd5703ee-14c9-4a3d-8806-b0f63b137481 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:58.856704 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd5703ee-14c9-4a3d-8806-b0f63b137481 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:58.857231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd5703ee-14c9-4a3d-8806-b0f63b137481 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:58.945349 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8e1439e0-526c-4003-a8ad-d0ae1ac88198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:58.946187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8e1439e0-526c-4003-a8ad-d0ae1ac88198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:58.953052 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8e1439e0-526c-4003-a8ad-d0ae1ac88198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:58.953589 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8e1439e0-526c-4003-a8ad-d0ae1ac88198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:58.954423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8e1439e0-526c-4003-a8ad-d0ae1ac88198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:58.954866 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8e1439e0-526c-4003-a8ad-d0ae1ac88198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:59.090254 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cd5703ee-14c9-4a3d-8806-b0f63b137481 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:59.099256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cd5703ee-14c9-4a3d-8806-b0f63b137481 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.256474 Apr 12 14:54:59.099852 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 43/98] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:58 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:59.106324 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6e17027d-8d6d-4694-a961-783ebadf9370 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:59.107173 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6e17027d-8d6d-4694-a961-783ebadf9370 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:59.113736 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e17027d-8d6d-4694-a961-783ebadf9370 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:59.114185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e17027d-8d6d-4694-a961-783ebadf9370 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:59.115081 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e17027d-8d6d-4694-a961-783ebadf9370 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:59.115580 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e17027d-8d6d-4694-a961-783ebadf9370 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:59.129755 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8e1439e0-526c-4003-a8ad-d0ae1ac88198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:59.138772 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8e1439e0-526c-4003-a8ad-d0ae1ac88198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.197696 Apr 12 14:54:59.139341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 56/99] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:58 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:59.256951 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6e17027d-8d6d-4694-a961-783ebadf9370 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:59.264350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6e17027d-8d6d-4694-a961-783ebadf9370 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.163227 Apr 12 14:54:59.264928 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 44/100] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:59 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:54:59.619773 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-df9725e5-99a2-4a15-bad5-62cdb7a2d593 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:59.620720 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-df9725e5-99a2-4a15-bad5-62cdb7a2d593 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:59.627176 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df9725e5-99a2-4a15-bad5-62cdb7a2d593 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:59.627795 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df9725e5-99a2-4a15-bad5-62cdb7a2d593 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:59.628473 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df9725e5-99a2-4a15-bad5-62cdb7a2d593 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:59.628916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df9725e5-99a2-4a15-bad5-62cdb7a2d593 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:59.629667 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-46f723a6-c0a8-4836-b800-3f8eb4d552d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:54:59.630353 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-46f723a6-c0a8-4836-b800-3f8eb4d552d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:54:59.636816 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-46f723a6-c0a8-4836-b800-3f8eb4d552d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:59.637347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-46f723a6-c0a8-4836-b800-3f8eb4d552d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:59.638247 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-46f723a6-c0a8-4836-b800-3f8eb4d552d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:54:59.638702 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-46f723a6-c0a8-4836-b800-3f8eb4d552d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:54:59.859326 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-df9725e5-99a2-4a15-bad5-62cdb7a2d593 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:59.870623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-df9725e5-99a2-4a15-bad5-62cdb7a2d593 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:59.873124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-df9725e5-99a2-4a15-bad5-62cdb7a2d593 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:59.873947 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-df9725e5-99a2-4a15-bad5-62cdb7a2d593 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.257902 Apr 12 14:54:59.874622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-46f723a6-c0a8-4836-b800-3f8eb4d552d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:54:59.878881 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 57/101] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:54:59 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:54:59.882463 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-46f723a6-c0a8-4836-b800-3f8eb4d552d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.257478 Apr 12 14:54:59.883090 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 45/102] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:54:59 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:00.121659 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0b95d127-f81b-4360-b36d-b747c78bc311 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:00.121659 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0b95d127-f81b-4360-b36d-b747c78bc311 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:00.126066 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b95d127-f81b-4360-b36d-b747c78bc311 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:00.126814 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b95d127-f81b-4360-b36d-b747c78bc311 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:00.127914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b95d127-f81b-4360-b36d-b747c78bc311 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:00.128843 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b95d127-f81b-4360-b36d-b747c78bc311 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:00.160296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d6691e81-f3eb-498b-b820-a80ac47eeecc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:00.161347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d6691e81-f3eb-498b-b820-a80ac47eeecc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:00.176015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6691e81-f3eb-498b-b820-a80ac47eeecc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:00.176653 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6691e81-f3eb-498b-b820-a80ac47eeecc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:00.179750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6691e81-f3eb-498b-b820-a80ac47eeecc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:00.180781 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6691e81-f3eb-498b-b820-a80ac47eeecc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:00.479785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d6691e81-f3eb-498b-b820-a80ac47eeecc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:00.492639 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d6691e81-f3eb-498b-b820-a80ac47eeecc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.339644 Apr 12 14:55:00.493470 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 46/103] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:00 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:00.498417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-49d95f5b-b97f-48ae-b23c-349e9ca48cf7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:00.499229 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-49d95f5b-b97f-48ae-b23c-349e9ca48cf7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:00.504859 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0b95d127-f81b-4360-b36d-b747c78bc311 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:00.505894 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49d95f5b-b97f-48ae-b23c-349e9ca48cf7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:00.506675 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49d95f5b-b97f-48ae-b23c-349e9ca48cf7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:00.507789 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49d95f5b-b97f-48ae-b23c-349e9ca48cf7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:00.514270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49d95f5b-b97f-48ae-b23c-349e9ca48cf7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:00.517021 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0b95d127-f81b-4360-b36d-b747c78bc311 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.404684 Apr 12 14:55:00.527811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 58/104] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:00 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:00.695838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-49d95f5b-b97f-48ae-b23c-349e9ca48cf7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:00.709470 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-49d95f5b-b97f-48ae-b23c-349e9ca48cf7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.214726 Apr 12 14:55:00.715915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 47/105] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:00 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:00.892467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-825334dd-1d7f-4906-9c1b-17f248d05c9f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:00.894472 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-825334dd-1d7f-4906-9c1b-17f248d05c9f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:00.904077 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-825334dd-1d7f-4906-9c1b-17f248d05c9f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:00.904565 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-825334dd-1d7f-4906-9c1b-17f248d05c9f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:00.905353 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-825334dd-1d7f-4906-9c1b-17f248d05c9f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:00.905836 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-825334dd-1d7f-4906-9c1b-17f248d05c9f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:00.907320 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-74ba43d9-66f5-4276-9bbd-eb2a1a055711 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:00.907933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-74ba43d9-66f5-4276-9bbd-eb2a1a055711 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:00.935656 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-74ba43d9-66f5-4276-9bbd-eb2a1a055711 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:00.936340 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-74ba43d9-66f5-4276-9bbd-eb2a1a055711 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:00.937134 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-74ba43d9-66f5-4276-9bbd-eb2a1a055711 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:00.937767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-74ba43d9-66f5-4276-9bbd-eb2a1a055711 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:01.156926 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-825334dd-1d7f-4906-9c1b-17f248d05c9f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:01.161908 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-74ba43d9-66f5-4276-9bbd-eb2a1a055711 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:01.172342 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-825334dd-1d7f-4906-9c1b-17f248d05c9f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:01.174479 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-825334dd-1d7f-4906-9c1b-17f248d05c9f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:01.175423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-74ba43d9-66f5-4276-9bbd-eb2a1a055711 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.277521 Apr 12 14:55:01.176706 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-825334dd-1d7f-4906-9c1b-17f248d05c9f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.287705 Apr 12 14:55:01.177287 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 59/106] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:00 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:01.178639 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 48/107] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:00 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:01.512358 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-434a8612-746c-4386-920c-44ca7660b0f5 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:01.513010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-434a8612-746c-4386-920c-44ca7660b0f5 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:01.521101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-434a8612-746c-4386-920c-44ca7660b0f5 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:01.521764 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-434a8612-746c-4386-920c-44ca7660b0f5 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:01.523436 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-434a8612-746c-4386-920c-44ca7660b0f5 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:01.524067 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-434a8612-746c-4386-920c-44ca7660b0f5 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:01.536578 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-25a0a11b-4194-4d46-ae5c-bf56672471c0 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:01.537066 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-25a0a11b-4194-4d46-ae5c-bf56672471c0 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:01.555562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25a0a11b-4194-4d46-ae5c-bf56672471c0 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:01.556015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25a0a11b-4194-4d46-ae5c-bf56672471c0 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:01.557624 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25a0a11b-4194-4d46-ae5c-bf56672471c0 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:01.558232 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25a0a11b-4194-4d46-ae5c-bf56672471c0 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:01.844431 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-434a8612-746c-4386-920c-44ca7660b0f5 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:01.855154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-434a8612-746c-4386-920c-44ca7660b0f5 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.348446 Apr 12 14:55:01.855755 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 60/108] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:01 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:01.868446 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b1c2b2ff-aa1c-4beb-8e87-21cd2715b2bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:01.869801 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b1c2b2ff-aa1c-4beb-8e87-21cd2715b2bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:01.871491 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-25a0a11b-4194-4d46-ae5c-bf56672471c0 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:01.890668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1c2b2ff-aa1c-4beb-8e87-21cd2715b2bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:01.891418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1c2b2ff-aa1c-4beb-8e87-21cd2715b2bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:01.893125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1c2b2ff-aa1c-4beb-8e87-21cd2715b2bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:01.894993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1c2b2ff-aa1c-4beb-8e87-21cd2715b2bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:01.899277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-25a0a11b-4194-4d46-ae5c-bf56672471c0 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1314 microversion: 2.1 time: 0.358211 Apr 12 14:55:01.899943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 49/109] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:01 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:02.100856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b1c2b2ff-aa1c-4beb-8e87-21cd2715b2bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:02.106479 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b1c2b2ff-aa1c-4beb-8e87-21cd2715b2bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.247542 Apr 12 14:55:02.107152 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 61/110] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:01 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:02.193278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fc036bc7-abab-4746-8503-41435ea294ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:02.193938 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fc036bc7-abab-4746-8503-41435ea294ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:02.204285 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc036bc7-abab-4746-8503-41435ea294ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:02.206426 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc036bc7-abab-4746-8503-41435ea294ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:02.207780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc036bc7-abab-4746-8503-41435ea294ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:02.210450 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-abe9411a-fb0b-400b-aa94-1c6f0c995624 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:02.210626 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc036bc7-abab-4746-8503-41435ea294ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:02.211278 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-abe9411a-fb0b-400b-aa94-1c6f0c995624 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:02.220991 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abe9411a-fb0b-400b-aa94-1c6f0c995624 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:02.221523 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abe9411a-fb0b-400b-aa94-1c6f0c995624 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:02.222413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abe9411a-fb0b-400b-aa94-1c6f0c995624 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:02.222916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abe9411a-fb0b-400b-aa94-1c6f0c995624 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:02.446431 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fc036bc7-abab-4746-8503-41435ea294ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:02.451851 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-abe9411a-fb0b-400b-aa94-1c6f0c995624 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:02.460690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-abe9411a-fb0b-400b-aa94-1c6f0c995624 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:02.461039 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fc036bc7-abab-4746-8503-41435ea294ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.271756 Apr 12 14:55:02.462004 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 50/111] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:02 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:02.463441 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-abe9411a-fb0b-400b-aa94-1c6f0c995624 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:02.465107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-abe9411a-fb0b-400b-aa94-1c6f0c995624 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.274187 Apr 12 14:55:02.465897 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 62/112] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:02 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:55:02.874276 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cc45acbd-6bea-4b4d-bd9f-dcf6bdbbf044 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:02.875008 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cc45acbd-6bea-4b4d-bd9f-dcf6bdbbf044 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:02.881169 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cc45acbd-6bea-4b4d-bd9f-dcf6bdbbf044 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:02.881689 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cc45acbd-6bea-4b4d-bd9f-dcf6bdbbf044 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:02.882732 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cc45acbd-6bea-4b4d-bd9f-dcf6bdbbf044 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:02.886452 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cc45acbd-6bea-4b4d-bd9f-dcf6bdbbf044 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:02.922985 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2d70b8ae-599d-4ccf-a176-0df6e16fc9c2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:02.923674 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2d70b8ae-599d-4ccf-a176-0df6e16fc9c2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:02.939473 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2d70b8ae-599d-4ccf-a176-0df6e16fc9c2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:02.940504 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2d70b8ae-599d-4ccf-a176-0df6e16fc9c2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:02.942006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2d70b8ae-599d-4ccf-a176-0df6e16fc9c2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:02.943045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2d70b8ae-599d-4ccf-a176-0df6e16fc9c2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:03.113812 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cc45acbd-6bea-4b4d-bd9f-dcf6bdbbf044 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:03.126111 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cc45acbd-6bea-4b4d-bd9f-dcf6bdbbf044 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.256509 Apr 12 14:55:03.126778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 51/113] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:02 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:03.142626 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-68ec006b-5b1c-4848-96f9-ff50686ae68e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:03.143258 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-68ec006b-5b1c-4848-96f9-ff50686ae68e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:03.149935 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-68ec006b-5b1c-4848-96f9-ff50686ae68e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:03.150435 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-68ec006b-5b1c-4848-96f9-ff50686ae68e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:03.151209 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-68ec006b-5b1c-4848-96f9-ff50686ae68e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:03.151909 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-68ec006b-5b1c-4848-96f9-ff50686ae68e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:03.293210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2d70b8ae-599d-4ccf-a176-0df6e16fc9c2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:03.301277 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2d70b8ae-599d-4ccf-a176-0df6e16fc9c2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1501 microversion: 2.1 time: 0.383694 Apr 12 14:55:03.301915 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 63/114] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:02 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1501 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:03.355467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-68ec006b-5b1c-4848-96f9-ff50686ae68e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:03.366724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-68ec006b-5b1c-4848-96f9-ff50686ae68e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.238470 Apr 12 14:55:03.367618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 52/115] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:03 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:03.480354 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dcd47c4a-4ff9-4d58-b3c4-c3ff45880f5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:03.481219 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dcd47c4a-4ff9-4d58-b3c4-c3ff45880f5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:03.483138 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-322cc72d-b364-42e5-97c5-04e657b7bd19 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:03.483696 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-322cc72d-b364-42e5-97c5-04e657b7bd19 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:03.487957 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dcd47c4a-4ff9-4d58-b3c4-c3ff45880f5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:03.488402 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dcd47c4a-4ff9-4d58-b3c4-c3ff45880f5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:03.489410 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dcd47c4a-4ff9-4d58-b3c4-c3ff45880f5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:03.489872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dcd47c4a-4ff9-4d58-b3c4-c3ff45880f5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:03.490050 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-322cc72d-b364-42e5-97c5-04e657b7bd19 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:03.490653 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-322cc72d-b364-42e5-97c5-04e657b7bd19 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:03.491423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-322cc72d-b364-42e5-97c5-04e657b7bd19 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:03.491847 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-322cc72d-b364-42e5-97c5-04e657b7bd19 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:03.946029 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dcd47c4a-4ff9-4d58-b3c4-c3ff45880f5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:03.952191 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-322cc72d-b364-42e5-97c5-04e657b7bd19 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:03.955259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dcd47c4a-4ff9-4d58-b3c4-c3ff45880f5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.479993 Apr 12 14:55:03.956115 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 64/116] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:03 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:03.960836 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-322cc72d-b364-42e5-97c5-04e657b7bd19 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:03.962383 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-322cc72d-b364-42e5-97c5-04e657b7bd19 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:03.964233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-322cc72d-b364-42e5-97c5-04e657b7bd19 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.485288 Apr 12 14:55:03.964788 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 53/117] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:03 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:04.149333 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b67dc40d-951e-484d-9a14-35c41567be79 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:04.150085 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b67dc40d-951e-484d-9a14-35c41567be79 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:04.162467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b67dc40d-951e-484d-9a14-35c41567be79 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:04.162901 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b67dc40d-951e-484d-9a14-35c41567be79 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:04.165119 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b67dc40d-951e-484d-9a14-35c41567be79 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:04.166393 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b67dc40d-951e-484d-9a14-35c41567be79 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:04.387424 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-420fb74c-60f1-43ce-9bd1-970313a8cf8f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:04.388045 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-420fb74c-60f1-43ce-9bd1-970313a8cf8f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:04.396440 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-420fb74c-60f1-43ce-9bd1-970313a8cf8f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:04.401975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-420fb74c-60f1-43ce-9bd1-970313a8cf8f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:04.403341 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-420fb74c-60f1-43ce-9bd1-970313a8cf8f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:04.412092 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-420fb74c-60f1-43ce-9bd1-970313a8cf8f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:04.434620 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b67dc40d-951e-484d-9a14-35c41567be79 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:04.444675 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b67dc40d-951e-484d-9a14-35c41567be79 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.298543 Apr 12 14:55:04.444675 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 65/118] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:04 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:04.632285 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-420fb74c-60f1-43ce-9bd1-970313a8cf8f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:04.641569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-420fb74c-60f1-43ce-9bd1-970313a8cf8f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.259072 Apr 12 14:55:04.642705 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 54/119] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:04 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:04.972934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-690f7495-4f56-4ba8-925b-df5d98769e61 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:04.974841 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-690f7495-4f56-4ba8-925b-df5d98769e61 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:04.985673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d215659a-b27a-42cc-bf80-b3c347cb77e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:04.986579 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d215659a-b27a-42cc-bf80-b3c347cb77e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:04.998357 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d215659a-b27a-42cc-bf80-b3c347cb77e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:05.003897 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-690f7495-4f56-4ba8-925b-df5d98769e61 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:05.004158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-690f7495-4f56-4ba8-925b-df5d98769e61 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:05.005031 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-690f7495-4f56-4ba8-925b-df5d98769e61 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:05.005525 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-690f7495-4f56-4ba8-925b-df5d98769e61 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:05.007555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d215659a-b27a-42cc-bf80-b3c347cb77e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:05.008539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d215659a-b27a-42cc-bf80-b3c347cb77e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:05.008974 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d215659a-b27a-42cc-bf80-b3c347cb77e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:05.269416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d215659a-b27a-42cc-bf80-b3c347cb77e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:05.274465 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-690f7495-4f56-4ba8-925b-df5d98769e61 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:05.295578 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d215659a-b27a-42cc-bf80-b3c347cb77e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:05.298254 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d215659a-b27a-42cc-bf80-b3c347cb77e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:05.298547 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-690f7495-4f56-4ba8-925b-df5d98769e61 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.326540 Apr 12 14:55:05.300341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 66/120] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:04 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:05.304174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d215659a-b27a-42cc-bf80-b3c347cb77e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.323437 Apr 12 14:55:05.305887 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 55/121] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:04 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:05.315231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d23b416c-0326-498b-839d-f6c1ab386e5e tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f1f80cb-9b3d-43e3-9ecc-08ff8bf99c0d"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:05.317144 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d23b416c-0326-498b-839d-f6c1ab386e5e tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:05.325349 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d23b416c-0326-498b-839d-f6c1ab386e5e tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:05.325941 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d23b416c-0326-498b-839d-f6c1ab386e5e tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:05.326800 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d23b416c-0326-498b-839d-f6c1ab386e5e tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:05.327315 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d23b416c-0326-498b-839d-f6c1ab386e5e tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:05.462087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a90f35d7-697f-42ee-b984-02c8600a2198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:05.463246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a90f35d7-697f-42ee-b984-02c8600a2198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:05.473906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a90f35d7-697f-42ee-b984-02c8600a2198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:05.474349 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a90f35d7-697f-42ee-b984-02c8600a2198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:05.475152 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a90f35d7-697f-42ee-b984-02c8600a2198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:05.480855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a90f35d7-697f-42ee-b984-02c8600a2198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:05.761227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a90f35d7-697f-42ee-b984-02c8600a2198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:05.778119 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a90f35d7-697f-42ee-b984-02c8600a2198 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.320411 Apr 12 14:55:05.779198 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 56/122] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:05 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:05.794472 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-45c4ba77-8b9a-488f-87b9-5e01da25fcf6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:05.795372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-45c4ba77-8b9a-488f-87b9-5e01da25fcf6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:05.804089 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45c4ba77-8b9a-488f-87b9-5e01da25fcf6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:05.804777 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45c4ba77-8b9a-488f-87b9-5e01da25fcf6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:05.806217 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45c4ba77-8b9a-488f-87b9-5e01da25fcf6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:05.807503 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45c4ba77-8b9a-488f-87b9-5e01da25fcf6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:06.032105 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-45c4ba77-8b9a-488f-87b9-5e01da25fcf6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:06.045164 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-45c4ba77-8b9a-488f-87b9-5e01da25fcf6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.264457 Apr 12 14:55:06.055173 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 57/123] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:05 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:06.125236 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-d11345b9-4bb0-4b30-b49d-cc38e08c8ec3 req-ee9bf6b3-e924-489e-88e2-fd02abe56085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3e6773-eb1f-4098-b443-1b2d62d1abe8", "name": "network-vif-plugged", "status": "completed", "tag": "7448f465-5339-4bd1-91a9-94095a601931"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:06.135438 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-d11345b9-4bb0-4b30-b49d-cc38e08c8ec3 req-ee9bf6b3-e924-489e-88e2-fd02abe56085 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:06.136259 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-d11345b9-4bb0-4b30-b49d-cc38e08c8ec3 req-ee9bf6b3-e924-489e-88e2-fd02abe56085 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:06.152961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-d11345b9-4bb0-4b30-b49d-cc38e08c8ec3 req-ee9bf6b3-e924-489e-88e2-fd02abe56085 service nova] Creating event network-vif-plugged:7448f465-5339-4bd1-91a9-94095a601931 for instance cc3e6773-eb1f-4098-b443-1b2d62d1abe8 on hv-cinder-83752 Apr 12 14:55:06.159195 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-d11345b9-4bb0-4b30-b49d-cc38e08c8ec3 req-ee9bf6b3-e924-489e-88e2-fd02abe56085 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041276 Apr 12 14:55:06.160529 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 58/124] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:06.318074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-66466062-b9db-4005-964b-4403047db5f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:06.320171 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-66466062-b9db-4005-964b-4403047db5f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:06.327541 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66466062-b9db-4005-964b-4403047db5f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:06.328092 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66466062-b9db-4005-964b-4403047db5f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:06.329079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66466062-b9db-4005-964b-4403047db5f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:06.329584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66466062-b9db-4005-964b-4403047db5f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:06.494681 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-66466062-b9db-4005-964b-4403047db5f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:06.504861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-66466062-b9db-4005-964b-4403047db5f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.191459 Apr 12 14:55:06.505453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 59/125] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:06 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:06.510241 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-88a521dc-983a-4dc8-ad55-21da6c13a811 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:06.510844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-88a521dc-983a-4dc8-ad55-21da6c13a811 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:06.517041 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88a521dc-983a-4dc8-ad55-21da6c13a811 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:06.517481 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88a521dc-983a-4dc8-ad55-21da6c13a811 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:06.518287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88a521dc-983a-4dc8-ad55-21da6c13a811 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:06.518714 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88a521dc-983a-4dc8-ad55-21da6c13a811 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:06.818494 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-88a521dc-983a-4dc8-ad55-21da6c13a811 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:06.829444 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-88a521dc-983a-4dc8-ad55-21da6c13a811 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:06.834880 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-88a521dc-983a-4dc8-ad55-21da6c13a811 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:06.836246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-88a521dc-983a-4dc8-ad55-21da6c13a811 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.329821 Apr 12 14:55:06.843798 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 60/126] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:06 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:06.863981 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4eb801d7-8677-42ee-8d0a-8d90b7bf733d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:06.865067 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4eb801d7-8677-42ee-8d0a-8d90b7bf733d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:06.879441 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4eb801d7-8677-42ee-8d0a-8d90b7bf733d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:06.879892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4eb801d7-8677-42ee-8d0a-8d90b7bf733d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:06.881608 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4eb801d7-8677-42ee-8d0a-8d90b7bf733d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:06.882101 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4eb801d7-8677-42ee-8d0a-8d90b7bf733d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:07.117390 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4eb801d7-8677-42ee-8d0a-8d90b7bf733d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:07.131030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4eb801d7-8677-42ee-8d0a-8d90b7bf733d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.285246 Apr 12 14:55:07.131659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 61/127] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:06 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:07.138559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-059743cb-ae8d-4362-bb50-ac3c11b56d66 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:07.139393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-059743cb-ae8d-4362-bb50-ac3c11b56d66 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:07.161069 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-059743cb-ae8d-4362-bb50-ac3c11b56d66 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:07.161546 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-059743cb-ae8d-4362-bb50-ac3c11b56d66 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:07.162352 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-059743cb-ae8d-4362-bb50-ac3c11b56d66 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:07.162927 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-059743cb-ae8d-4362-bb50-ac3c11b56d66 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:07.349737 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d23b416c-0326-498b-839d-f6c1ab386e5e tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "POST /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.047754 Apr 12 14:55:07.357110 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 67/128] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 14:55:05 2022] POST /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9/os-volume_attachments => generated 194 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:07.373842 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-059743cb-ae8d-4362-bb50-ac3c11b56d66 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:07.381929 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-059743cb-ae8d-4362-bb50-ac3c11b56d66 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.248928 Apr 12 14:55:07.382452 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 62/129] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:07 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:07.535457 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c016ab41-d180-4e7c-a981-7a2d10c1831d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:07.536210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c016ab41-d180-4e7c-a981-7a2d10c1831d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:07.542772 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c016ab41-d180-4e7c-a981-7a2d10c1831d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:07.543222 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c016ab41-d180-4e7c-a981-7a2d10c1831d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:07.544003 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c016ab41-d180-4e7c-a981-7a2d10c1831d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:07.544468 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c016ab41-d180-4e7c-a981-7a2d10c1831d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:07.731374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c016ab41-d180-4e7c-a981-7a2d10c1831d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:07.739013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c016ab41-d180-4e7c-a981-7a2d10c1831d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.218718 Apr 12 14:55:07.750447 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 68/130] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:07 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:07.862658 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5579f557-b2d4-41fe-b102-d0ddbb88f501 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:07.864501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5579f557-b2d4-41fe-b102-d0ddbb88f501 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:07.872097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5579f557-b2d4-41fe-b102-d0ddbb88f501 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:07.873104 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5579f557-b2d4-41fe-b102-d0ddbb88f501 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:07.874577 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5579f557-b2d4-41fe-b102-d0ddbb88f501 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:07.875018 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5579f557-b2d4-41fe-b102-d0ddbb88f501 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:08.036261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5579f557-b2d4-41fe-b102-d0ddbb88f501 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:08.045652 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5579f557-b2d4-41fe-b102-d0ddbb88f501 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:08.047187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5579f557-b2d4-41fe-b102-d0ddbb88f501 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:08.048296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5579f557-b2d4-41fe-b102-d0ddbb88f501 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.189925 Apr 12 14:55:08.049231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 63/131] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:07 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:08.150809 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-92f7f08d-ab96-493d-8daa-bde3cd683248 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:08.152046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-92f7f08d-ab96-493d-8daa-bde3cd683248 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:08.159969 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-92f7f08d-ab96-493d-8daa-bde3cd683248 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:08.160893 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-92f7f08d-ab96-493d-8daa-bde3cd683248 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:08.161868 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-92f7f08d-ab96-493d-8daa-bde3cd683248 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:08.162468 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-92f7f08d-ab96-493d-8daa-bde3cd683248 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:08.304809 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-92f7f08d-ab96-493d-8daa-bde3cd683248 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:08.312210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-92f7f08d-ab96-493d-8daa-bde3cd683248 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1361 microversion: 2.1 time: 0.167738 Apr 12 14:55:08.312787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 69/132] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:08 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:08.401312 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d2ce5bd4-8cbd-4b21-9bf2-3a1e9b18b03a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:08.402008 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d2ce5bd4-8cbd-4b21-9bf2-3a1e9b18b03a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:08.411225 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d2ce5bd4-8cbd-4b21-9bf2-3a1e9b18b03a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:08.411724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d2ce5bd4-8cbd-4b21-9bf2-3a1e9b18b03a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:08.412550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d2ce5bd4-8cbd-4b21-9bf2-3a1e9b18b03a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:08.415474 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d2ce5bd4-8cbd-4b21-9bf2-3a1e9b18b03a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:08.571391 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d2ce5bd4-8cbd-4b21-9bf2-3a1e9b18b03a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:08.580994 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d2ce5bd4-8cbd-4b21-9bf2-3a1e9b18b03a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.184061 Apr 12 14:55:08.581677 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 64/133] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:08 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:08.757096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0d4a3174-1c50-4b91-85cd-c33e1b63b1bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:08.757925 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0d4a3174-1c50-4b91-85cd-c33e1b63b1bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:08.764976 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0d4a3174-1c50-4b91-85cd-c33e1b63b1bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:08.765422 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0d4a3174-1c50-4b91-85cd-c33e1b63b1bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:08.766371 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0d4a3174-1c50-4b91-85cd-c33e1b63b1bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:08.766801 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0d4a3174-1c50-4b91-85cd-c33e1b63b1bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:08.907857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0d4a3174-1c50-4b91-85cd-c33e1b63b1bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:08.920658 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0d4a3174-1c50-4b91-85cd-c33e1b63b1bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.167046 Apr 12 14:55:08.921378 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 70/134] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:08 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:09.066547 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a058fa87-c62a-425f-8b07-0f26c5305b34 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:09.067148 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a058fa87-c62a-425f-8b07-0f26c5305b34 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:09.074289 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a058fa87-c62a-425f-8b07-0f26c5305b34 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:09.074783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a058fa87-c62a-425f-8b07-0f26c5305b34 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:09.075624 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a058fa87-c62a-425f-8b07-0f26c5305b34 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:09.076087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a058fa87-c62a-425f-8b07-0f26c5305b34 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:09.205620 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a058fa87-c62a-425f-8b07-0f26c5305b34 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:09.214813 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a058fa87-c62a-425f-8b07-0f26c5305b34 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:09.216923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a058fa87-c62a-425f-8b07-0f26c5305b34 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:09.218053 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a058fa87-c62a-425f-8b07-0f26c5305b34 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.155440 Apr 12 14:55:09.218693 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 65/135] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:09 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:09.329184 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e25d0132-ce17-43dc-aba4-b8d9b02500e7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:09.329829 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e25d0132-ce17-43dc-aba4-b8d9b02500e7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:09.336428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e25d0132-ce17-43dc-aba4-b8d9b02500e7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:09.336949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e25d0132-ce17-43dc-aba4-b8d9b02500e7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:09.338006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e25d0132-ce17-43dc-aba4-b8d9b02500e7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:09.338565 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e25d0132-ce17-43dc-aba4-b8d9b02500e7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:09.474415 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e25d0132-ce17-43dc-aba4-b8d9b02500e7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:09.482739 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e25d0132-ce17-43dc-aba4-b8d9b02500e7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1548 microversion: 2.1 time: 0.157460 Apr 12 14:55:09.483322 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 71/136] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:09 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:09.504417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-80ab3b8e-d1b2-4b2a-b4bf-064966b180d7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:09.504999 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-80ab3b8e-d1b2-4b2a-b4bf-064966b180d7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:09.513347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80ab3b8e-d1b2-4b2a-b4bf-064966b180d7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:09.513972 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80ab3b8e-d1b2-4b2a-b4bf-064966b180d7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:09.515202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80ab3b8e-d1b2-4b2a-b4bf-064966b180d7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:09.515956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80ab3b8e-d1b2-4b2a-b4bf-064966b180d7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:09.598076 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-97850594-3930-4fd7-96de-e88b67e01349 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:09.599030 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-97850594-3930-4fd7-96de-e88b67e01349 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:09.607871 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-97850594-3930-4fd7-96de-e88b67e01349 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:09.608890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-97850594-3930-4fd7-96de-e88b67e01349 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:09.609860 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-97850594-3930-4fd7-96de-e88b67e01349 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:09.612698 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-97850594-3930-4fd7-96de-e88b67e01349 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:09.693666 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-80ab3b8e-d1b2-4b2a-b4bf-064966b180d7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194692 Apr 12 14:55:09.694299 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 66/137] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Apr 12 14:55:09 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:09.764493 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-97850594-3930-4fd7-96de-e88b67e01349 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:09.772920 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-97850594-3930-4fd7-96de-e88b67e01349 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.178859 Apr 12 14:55:09.773521 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 72/138] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:09 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:09.945036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-25111f06-37c6-4714-a913-f0ae20cc2fda tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:09.945864 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-25111f06-37c6-4714-a913-f0ae20cc2fda tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:09.953493 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25111f06-37c6-4714-a913-f0ae20cc2fda tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:09.954127 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25111f06-37c6-4714-a913-f0ae20cc2fda tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:09.955019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25111f06-37c6-4714-a913-f0ae20cc2fda tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:09.955820 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25111f06-37c6-4714-a913-f0ae20cc2fda tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:10.124210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-25111f06-37c6-4714-a913-f0ae20cc2fda tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:10.132865 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-25111f06-37c6-4714-a913-f0ae20cc2fda tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.191929 Apr 12 14:55:10.133728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 67/139] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:09 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:10.211009 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-b9e55b17-b9ea-45f7-a646-05915d17f0f1 req-52016f48-b893-4f1f-b1f9-42ef8a7f9f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e6b586-ce02-4394-a2a1-6ae5e0f09306", "name": "network-vif-plugged", "status": "completed", "tag": "f7b6eb0e-0b23-4a4b-81d8-d386bce95c9e"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:10.219831 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-b9e55b17-b9ea-45f7-a646-05915d17f0f1 req-52016f48-b893-4f1f-b1f9-42ef8a7f9f73 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:10.220274 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-b9e55b17-b9ea-45f7-a646-05915d17f0f1 req-52016f48-b893-4f1f-b1f9-42ef8a7f9f73 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:10.232961 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-b9e55b17-b9ea-45f7-a646-05915d17f0f1 req-52016f48-b893-4f1f-b1f9-42ef8a7f9f73 service nova] Creating event network-vif-plugged:f7b6eb0e-0b23-4a4b-81d8-d386bce95c9e for instance 92e6b586-ce02-4394-a2a1-6ae5e0f09306 on hv-cinder-83752 Apr 12 14:55:10.237215 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-30205e23-4d6d-4718-8902-8e9183d68b23 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:10.238187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-30205e23-4d6d-4718-8902-8e9183d68b23 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:10.240583 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-b9e55b17-b9ea-45f7-a646-05915d17f0f1 req-52016f48-b893-4f1f-b1f9-42ef8a7f9f73 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042135 Apr 12 14:55:10.244239 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 73/140] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:10.245136 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30205e23-4d6d-4718-8902-8e9183d68b23 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:10.245589 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30205e23-4d6d-4718-8902-8e9183d68b23 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:10.246634 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30205e23-4d6d-4718-8902-8e9183d68b23 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:10.246995 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30205e23-4d6d-4718-8902-8e9183d68b23 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:10.597268 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-30205e23-4d6d-4718-8902-8e9183d68b23 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:10.607278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-30205e23-4d6d-4718-8902-8e9183d68b23 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:10.608803 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-30205e23-4d6d-4718-8902-8e9183d68b23 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:10.609947 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-30205e23-4d6d-4718-8902-8e9183d68b23 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.377516 Apr 12 14:55:10.610511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 68/141] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:10 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:55:10.791393 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3d3cdd7d-6818-46ec-b464-705db6004ac3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:10.792182 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3d3cdd7d-6818-46ec-b464-705db6004ac3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:10.798486 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d3cdd7d-6818-46ec-b464-705db6004ac3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:10.799053 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d3cdd7d-6818-46ec-b464-705db6004ac3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:10.799863 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d3cdd7d-6818-46ec-b464-705db6004ac3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:10.800522 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d3cdd7d-6818-46ec-b464-705db6004ac3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:10.963592 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3d3cdd7d-6818-46ec-b464-705db6004ac3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:10.971514 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3d3cdd7d-6818-46ec-b464-705db6004ac3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.185276 Apr 12 14:55:10.981397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 74/142] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:10 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:11.150952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-70a05557-fe36-4a9b-b9c8-e4e94b3283c8 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:11.154521 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-70a05557-fe36-4a9b-b9c8-e4e94b3283c8 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:11.160877 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-70a05557-fe36-4a9b-b9c8-e4e94b3283c8 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:11.161592 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-70a05557-fe36-4a9b-b9c8-e4e94b3283c8 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:11.162579 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-70a05557-fe36-4a9b-b9c8-e4e94b3283c8 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:11.163130 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-70a05557-fe36-4a9b-b9c8-e4e94b3283c8 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:11.321131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-70a05557-fe36-4a9b-b9c8-e4e94b3283c8 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:11.330918 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-70a05557-fe36-4a9b-b9c8-e4e94b3283c8 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.184123 Apr 12 14:55:11.333970 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 69/143] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:11 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:11.429419 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-f1cbe0a9-a137-4f31-b801-f8e1dcb636ce req-1d501fab-b804-451b-9571-927adf66fc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc3e6773-eb1f-4098-b443-1b2d62d1abe8", "tag": "7448f465-5339-4bd1-91a9-94095a601931"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:11.438293 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-f1cbe0a9-a137-4f31-b801-f8e1dcb636ce req-1d501fab-b804-451b-9571-927adf66fc49 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:11.438737 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-f1cbe0a9-a137-4f31-b801-f8e1dcb636ce req-1d501fab-b804-451b-9571-927adf66fc49 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:11.453997 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-f1cbe0a9-a137-4f31-b801-f8e1dcb636ce req-1d501fab-b804-451b-9571-927adf66fc49 service nova] Creating event network-changed:7448f465-5339-4bd1-91a9-94095a601931 for instance cc3e6773-eb1f-4098-b443-1b2d62d1abe8 on hv-cinder-83752 Apr 12 14:55:11.463529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-f1cbe0a9-a137-4f31-b801-f8e1dcb636ce req-1d501fab-b804-451b-9571-927adf66fc49 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042979 Apr 12 14:55:11.466240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 75/144] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:11.629531 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1e5b9307-f17e-4d08-8746-2e444244ffcb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:11.630931 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1e5b9307-f17e-4d08-8746-2e444244ffcb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:11.643091 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e5b9307-f17e-4d08-8746-2e444244ffcb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:11.645308 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e5b9307-f17e-4d08-8746-2e444244ffcb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:11.649486 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e5b9307-f17e-4d08-8746-2e444244ffcb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:11.651846 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e5b9307-f17e-4d08-8746-2e444244ffcb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:11.940179 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1e5b9307-f17e-4d08-8746-2e444244ffcb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:11.950739 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1e5b9307-f17e-4d08-8746-2e444244ffcb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:11.952338 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1e5b9307-f17e-4d08-8746-2e444244ffcb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:11.953461 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1e5b9307-f17e-4d08-8746-2e444244ffcb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.328579 Apr 12 14:55:11.954242 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 70/145] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:11 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:11.992306 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-416cdb35-c22a-483a-9e8f-f26fcf60aeb8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:11.993736 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-416cdb35-c22a-483a-9e8f-f26fcf60aeb8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:12.000482 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-416cdb35-c22a-483a-9e8f-f26fcf60aeb8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:12.001304 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-416cdb35-c22a-483a-9e8f-f26fcf60aeb8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:12.002944 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-416cdb35-c22a-483a-9e8f-f26fcf60aeb8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:12.003608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-416cdb35-c22a-483a-9e8f-f26fcf60aeb8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:12.297789 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-83df0126-0284-4f72-b18e-9cf5485329bb req-5c71c06c-f7b6-4c97-8a9d-f5b75dfa532e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e10895-454d-437b-9325-591ccaa80da9", "name": "network-vif-plugged", "status": "completed", "tag": "83c56c7d-fadb-4e42-871f-2399e0153f94"}, {"server_uuid": "9d03f42e-2d51-459d-ade0-7e6a34283867", "name": "network-vif-plugged", "status": "completed", "tag": "90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77"}, {"server_uuid": "71207994-1780-4e45-b693-8455d8038f21", "name": "network-vif-plugged", "status": "completed", "tag": "5d8aa5a2-fd7c-4d6a-b44f-15e67a9087c0"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:12.310569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-83df0126-0284-4f72-b18e-9cf5485329bb req-5c71c06c-f7b6-4c97-8a9d-f5b75dfa532e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:12.311258 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-83df0126-0284-4f72-b18e-9cf5485329bb req-5c71c06c-f7b6-4c97-8a9d-f5b75dfa532e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:12.329983 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-83df0126-0284-4f72-b18e-9cf5485329bb req-5c71c06c-f7b6-4c97-8a9d-f5b75dfa532e service nova] Creating event network-vif-plugged:83c56c7d-fadb-4e42-871f-2399e0153f94 for instance e2e10895-454d-437b-9325-591ccaa80da9 on hv-cinder-83752 Apr 12 14:55:12.330924 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-83df0126-0284-4f72-b18e-9cf5485329bb req-5c71c06c-f7b6-4c97-8a9d-f5b75dfa532e service nova] Creating event network-vif-plugged:90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77 for instance 9d03f42e-2d51-459d-ade0-7e6a34283867 on hv-cinder-83752 Apr 12 14:55:12.331489 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-83df0126-0284-4f72-b18e-9cf5485329bb req-5c71c06c-f7b6-4c97-8a9d-f5b75dfa532e service nova] Creating event network-vif-plugged:5d8aa5a2-fd7c-4d6a-b44f-15e67a9087c0 for instance 71207994-1780-4e45-b693-8455d8038f21 on hv-cinder-83752 Apr 12 14:55:12.341398 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-83df0126-0284-4f72-b18e-9cf5485329bb req-5c71c06c-f7b6-4c97-8a9d-f5b75dfa532e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.049240 Apr 12 14:55:12.343716 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 71/146] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:12.351727 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e2a1d76b-e371-4199-8e02-def47fe55c90 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:12.352653 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e2a1d76b-e371-4199-8e02-def47fe55c90 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:12.374489 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2a1d76b-e371-4199-8e02-def47fe55c90 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:12.379849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2a1d76b-e371-4199-8e02-def47fe55c90 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:12.381509 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2a1d76b-e371-4199-8e02-def47fe55c90 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:12.383026 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2a1d76b-e371-4199-8e02-def47fe55c90 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:12.480564 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-416cdb35-c22a-483a-9e8f-f26fcf60aeb8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:12.499187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-416cdb35-c22a-483a-9e8f-f26fcf60aeb8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.514184 Apr 12 14:55:12.500294 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 76/147] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:11 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:12.652526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e2a1d76b-e371-4199-8e02-def47fe55c90 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:12.670863 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e2a1d76b-e371-4199-8e02-def47fe55c90 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.325468 Apr 12 14:55:12.671484 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 72/148] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:12 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:12.978587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d0c58a49-6736-4bad-b782-db81e1ba256b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:12.982091 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d0c58a49-6736-4bad-b782-db81e1ba256b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:12.989694 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0c58a49-6736-4bad-b782-db81e1ba256b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:12.990231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0c58a49-6736-4bad-b782-db81e1ba256b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:12.991045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0c58a49-6736-4bad-b782-db81e1ba256b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:12.991941 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0c58a49-6736-4bad-b782-db81e1ba256b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:13.162873 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d0c58a49-6736-4bad-b782-db81e1ba256b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:13.172870 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d0c58a49-6736-4bad-b782-db81e1ba256b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:13.174487 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d0c58a49-6736-4bad-b782-db81e1ba256b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:13.175731 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d0c58a49-6736-4bad-b782-db81e1ba256b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.202171 Apr 12 14:55:13.176221 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 77/149] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:12 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:13.522673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cafa261d-794c-4aff-b7bb-c466278617f2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:13.551131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cafa261d-794c-4aff-b7bb-c466278617f2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:13.551131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cafa261d-794c-4aff-b7bb-c466278617f2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:13.551131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cafa261d-794c-4aff-b7bb-c466278617f2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:13.551131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cafa261d-794c-4aff-b7bb-c466278617f2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:13.552034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cafa261d-794c-4aff-b7bb-c466278617f2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:13.695284 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-839e5e66-a467-47ef-a8fc-6934466a83bc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:13.696363 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-839e5e66-a467-47ef-a8fc-6934466a83bc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:13.703903 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-839e5e66-a467-47ef-a8fc-6934466a83bc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:13.704548 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-839e5e66-a467-47ef-a8fc-6934466a83bc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:13.705784 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-839e5e66-a467-47ef-a8fc-6934466a83bc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:13.706233 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-839e5e66-a467-47ef-a8fc-6934466a83bc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:13.717279 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cafa261d-794c-4aff-b7bb-c466278617f2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:13.725750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cafa261d-794c-4aff-b7bb-c466278617f2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.209378 Apr 12 14:55:13.727330 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 73/150] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:13 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:13.848611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-839e5e66-a467-47ef-a8fc-6934466a83bc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:13.855980 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-839e5e66-a467-47ef-a8fc-6934466a83bc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.165278 Apr 12 14:55:13.856563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 78/151] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:13 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:14.195738 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f2da6cf8-1025-40ad-9878-b22d0a5cf28d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:14.196227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f2da6cf8-1025-40ad-9878-b22d0a5cf28d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:14.207104 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2da6cf8-1025-40ad-9878-b22d0a5cf28d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:14.207557 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2da6cf8-1025-40ad-9878-b22d0a5cf28d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:14.208534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2da6cf8-1025-40ad-9878-b22d0a5cf28d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:14.208973 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2da6cf8-1025-40ad-9878-b22d0a5cf28d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:14.364561 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f2da6cf8-1025-40ad-9878-b22d0a5cf28d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:14.376888 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f2da6cf8-1025-40ad-9878-b22d0a5cf28d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:14.378453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f2da6cf8-1025-40ad-9878-b22d0a5cf28d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:14.379674 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f2da6cf8-1025-40ad-9878-b22d0a5cf28d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.188119 Apr 12 14:55:14.380248 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 74/152] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:14 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:14.744558 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0b8fe945-61e6-42f6-80a4-23f488f9df11 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:14.745276 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0b8fe945-61e6-42f6-80a4-23f488f9df11 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:14.751609 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b8fe945-61e6-42f6-80a4-23f488f9df11 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:14.752059 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b8fe945-61e6-42f6-80a4-23f488f9df11 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:14.752925 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b8fe945-61e6-42f6-80a4-23f488f9df11 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:14.753359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b8fe945-61e6-42f6-80a4-23f488f9df11 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:14.874097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d64d3d79-9f05-429a-a426-15d87602ee37 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:14.874672 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d64d3d79-9f05-429a-a426-15d87602ee37 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:14.880970 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d64d3d79-9f05-429a-a426-15d87602ee37 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:14.881483 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d64d3d79-9f05-429a-a426-15d87602ee37 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:14.882233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d64d3d79-9f05-429a-a426-15d87602ee37 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:14.882668 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d64d3d79-9f05-429a-a426-15d87602ee37 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:14.894228 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0b8fe945-61e6-42f6-80a4-23f488f9df11 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:14.903354 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0b8fe945-61e6-42f6-80a4-23f488f9df11 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.163472 Apr 12 14:55:14.904787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 79/153] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:14 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:15.038936 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d64d3d79-9f05-429a-a426-15d87602ee37 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:15.046679 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d64d3d79-9f05-429a-a426-15d87602ee37 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.177882 Apr 12 14:55:15.047170 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 75/154] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:14 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:15.401695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3cedefbf-d870-4e8a-a426-a9fbadd2e403 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:15.402333 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3cedefbf-d870-4e8a-a426-a9fbadd2e403 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:15.408767 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cedefbf-d870-4e8a-a426-a9fbadd2e403 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:15.414260 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cedefbf-d870-4e8a-a426-a9fbadd2e403 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:15.414260 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cedefbf-d870-4e8a-a426-a9fbadd2e403 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:15.414260 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cedefbf-d870-4e8a-a426-a9fbadd2e403 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:15.649534 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3cedefbf-d870-4e8a-a426-a9fbadd2e403 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:15.659163 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3cedefbf-d870-4e8a-a426-a9fbadd2e403 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:15.660692 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3cedefbf-d870-4e8a-a426-a9fbadd2e403 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:15.661919 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3cedefbf-d870-4e8a-a426-a9fbadd2e403 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.266833 Apr 12 14:55:15.662483 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 80/155] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:15 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:15.920526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-47a29f70-e9e5-48b1-a496-5d366b045c0d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:15.921135 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-47a29f70-e9e5-48b1-a496-5d366b045c0d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:15.927080 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-47a29f70-e9e5-48b1-a496-5d366b045c0d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:15.927528 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-47a29f70-e9e5-48b1-a496-5d366b045c0d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:15.928293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-47a29f70-e9e5-48b1-a496-5d366b045c0d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:15.928727 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-47a29f70-e9e5-48b1-a496-5d366b045c0d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:16.066244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fa93937d-9a2e-433f-95ed-eaad90645bf4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:16.068361 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fa93937d-9a2e-433f-95ed-eaad90645bf4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:16.079475 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fa93937d-9a2e-433f-95ed-eaad90645bf4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:16.081772 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fa93937d-9a2e-433f-95ed-eaad90645bf4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:16.082887 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fa93937d-9a2e-433f-95ed-eaad90645bf4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:16.083646 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fa93937d-9a2e-433f-95ed-eaad90645bf4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:16.090168 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-47a29f70-e9e5-48b1-a496-5d366b045c0d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:16.096851 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-47a29f70-e9e5-48b1-a496-5d366b045c0d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.180314 Apr 12 14:55:16.106694 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 76/156] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:15 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:16.229948 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fa93937d-9a2e-433f-95ed-eaad90645bf4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:16.238473 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fa93937d-9a2e-433f-95ed-eaad90645bf4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.179185 Apr 12 14:55:16.241968 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 81/157] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:16 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:16.682679 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0d99321c-9a46-41c2-a1be-f87dafd67f8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:16.683453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0d99321c-9a46-41c2-a1be-f87dafd67f8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:16.703657 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d99321c-9a46-41c2-a1be-f87dafd67f8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:16.704118 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d99321c-9a46-41c2-a1be-f87dafd67f8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:16.704929 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d99321c-9a46-41c2-a1be-f87dafd67f8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:16.705612 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d99321c-9a46-41c2-a1be-f87dafd67f8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:16.870938 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0d99321c-9a46-41c2-a1be-f87dafd67f8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:16.881188 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0d99321c-9a46-41c2-a1be-f87dafd67f8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:16.883324 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0d99321c-9a46-41c2-a1be-f87dafd67f8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:16.886122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0d99321c-9a46-41c2-a1be-f87dafd67f8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.208868 Apr 12 14:55:16.896418 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 77/158] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:16 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:55:17.117490 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-41c8899d-8583-4bc2-97ad-4c610754bffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:17.117490 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-41c8899d-8583-4bc2-97ad-4c610754bffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:17.125167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-41c8899d-8583-4bc2-97ad-4c610754bffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:17.125793 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-41c8899d-8583-4bc2-97ad-4c610754bffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:17.126585 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-41c8899d-8583-4bc2-97ad-4c610754bffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:17.127024 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-41c8899d-8583-4bc2-97ad-4c610754bffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:17.257356 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2c2c2084-a750-4cee-951b-f3f726dc0fdd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:17.263673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2c2c2084-a750-4cee-951b-f3f726dc0fdd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:17.270581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c2c2084-a750-4cee-951b-f3f726dc0fdd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:17.271206 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c2c2084-a750-4cee-951b-f3f726dc0fdd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:17.272077 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c2c2084-a750-4cee-951b-f3f726dc0fdd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:17.272482 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c2c2084-a750-4cee-951b-f3f726dc0fdd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:17.333857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-41c8899d-8583-4bc2-97ad-4c610754bffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:17.342138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-41c8899d-8583-4bc2-97ad-4c610754bffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.231722 Apr 12 14:55:17.342883 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 82/159] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:17 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:17.426844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2c2c2084-a750-4cee-951b-f3f726dc0fdd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:17.435266 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2c2c2084-a750-4cee-951b-f3f726dc0fdd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.182645 Apr 12 14:55:17.435851 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 78/160] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:17 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:17.906739 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-06ab2a02-224f-401d-9737-34e557c63439 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:17.908619 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-06ab2a02-224f-401d-9737-34e557c63439 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:17.913379 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ab2a02-224f-401d-9737-34e557c63439 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:17.913864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ab2a02-224f-401d-9737-34e557c63439 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:17.914637 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ab2a02-224f-401d-9737-34e557c63439 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:17.915061 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ab2a02-224f-401d-9737-34e557c63439 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:18.073366 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-06ab2a02-224f-401d-9737-34e557c63439 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:18.086668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-06ab2a02-224f-401d-9737-34e557c63439 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:18.089751 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-06ab2a02-224f-401d-9737-34e557c63439 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:18.092732 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-06ab2a02-224f-401d-9737-34e557c63439 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.188690 Apr 12 14:55:18.093567 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 83/161] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:17 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:18.361853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-80e5ece1-7d7b-4e60-95ec-f9d8ec434323 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:18.362485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-80e5ece1-7d7b-4e60-95ec-f9d8ec434323 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:18.368778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80e5ece1-7d7b-4e60-95ec-f9d8ec434323 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:18.369451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80e5ece1-7d7b-4e60-95ec-f9d8ec434323 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:18.370612 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80e5ece1-7d7b-4e60-95ec-f9d8ec434323 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:18.371226 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80e5ece1-7d7b-4e60-95ec-f9d8ec434323 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:18.456618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d4cfa5f7-7dde-43a5-b710-05326d70c6a9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:18.457109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d4cfa5f7-7dde-43a5-b710-05326d70c6a9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:18.464341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4cfa5f7-7dde-43a5-b710-05326d70c6a9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:18.464656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4cfa5f7-7dde-43a5-b710-05326d70c6a9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:18.465424 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4cfa5f7-7dde-43a5-b710-05326d70c6a9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:18.465911 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4cfa5f7-7dde-43a5-b710-05326d70c6a9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:18.540473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-80e5ece1-7d7b-4e60-95ec-f9d8ec434323 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:18.557270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-80e5ece1-7d7b-4e60-95ec-f9d8ec434323 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.199550 Apr 12 14:55:18.568000 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 79/162] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:18 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:18.619677 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d4cfa5f7-7dde-43a5-b710-05326d70c6a9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:18.633165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d4cfa5f7-7dde-43a5-b710-05326d70c6a9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1367 microversion: 2.1 time: 0.175904 Apr 12 14:55:18.633165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 84/163] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:18 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:19.120943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0328153d-d256-4946-90ed-514537a90906 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:19.122130 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0328153d-d256-4946-90ed-514537a90906 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:19.129853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0328153d-d256-4946-90ed-514537a90906 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.130510 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0328153d-d256-4946-90ed-514537a90906 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.131524 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0328153d-d256-4946-90ed-514537a90906 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.132386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0328153d-d256-4946-90ed-514537a90906 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.153554 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d6297470-855a-45fc-85c1-3be3de0efc7b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:19.154088 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d6297470-855a-45fc-85c1-3be3de0efc7b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:19.162517 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d6297470-855a-45fc-85c1-3be3de0efc7b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.163018 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d6297470-855a-45fc-85c1-3be3de0efc7b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.170357 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d6297470-855a-45fc-85c1-3be3de0efc7b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.170357 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d6297470-855a-45fc-85c1-3be3de0efc7b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.200015 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d6297470-855a-45fc-85c1-3be3de0efc7b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 14:55:19.316791 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0328153d-d256-4946-90ed-514537a90906 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:19.324252 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0328153d-d256-4946-90ed-514537a90906 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:19.325790 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0328153d-d256-4946-90ed-514537a90906 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:19.327118 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0328153d-d256-4946-90ed-514537a90906 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1407 microversion: 2.20 time: 0.210444 Apr 12 14:55:19.339114 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 80/164] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:19 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:55:19.534465 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d6297470-855a-45fc-85c1-3be3de0efc7b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 204 len: 0 microversion: 2.1 time: 0.385600 Apr 12 14:55:19.535076 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 85/165] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 14:55:19 2022] DELETE /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 14:55:19.543670 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bea42423-6165-427a-83c5-81421761113f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:19.544961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bea42423-6165-427a-83c5-81421761113f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:19.551628 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bea42423-6165-427a-83c5-81421761113f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.552082 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bea42423-6165-427a-83c5-81421761113f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.552862 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bea42423-6165-427a-83c5-81421761113f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.553296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bea42423-6165-427a-83c5-81421761113f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.577195 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5e0ed2a2-069d-4c95-be7a-f6cde28a3bad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:19.578234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5e0ed2a2-069d-4c95-be7a-f6cde28a3bad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:19.585564 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5e0ed2a2-069d-4c95-be7a-f6cde28a3bad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.586163 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5e0ed2a2-069d-4c95-be7a-f6cde28a3bad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.586978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5e0ed2a2-069d-4c95-be7a-f6cde28a3bad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.587625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5e0ed2a2-069d-4c95-be7a-f6cde28a3bad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.762706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bea42423-6165-427a-83c5-81421761113f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:19.769978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5e0ed2a2-069d-4c95-be7a-f6cde28a3bad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:19.771116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bea42423-6165-427a-83c5-81421761113f tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1553 microversion: 2.1 time: 0.231704 Apr 12 14:55:19.771699 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 81/166] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:19 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:19.777947 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8ecdf98c-a156-4d57-acce-55c3833a18a6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:19.778391 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5e0ed2a2-069d-4c95-be7a-f6cde28a3bad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1322 microversion: 2.1 time: 0.207087 Apr 12 14:55:19.779012 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8ecdf98c-a156-4d57-acce-55c3833a18a6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:19.779145 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 86/167] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:19 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:19.785325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ecdf98c-a156-4d57-acce-55c3833a18a6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.785794 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ecdf98c-a156-4d57-acce-55c3833a18a6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.786587 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ecdf98c-a156-4d57-acce-55c3833a18a6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.787015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8ecdf98c-a156-4d57-acce-55c3833a18a6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.925895 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8ecdf98c-a156-4d57-acce-55c3833a18a6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:19.934288 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8ecdf98c-a156-4d57-acce-55c3833a18a6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1556 microversion: 2.1 time: 0.161367 Apr 12 14:55:19.938934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 82/168] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:19 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:19.954837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b8f57fd9-8eef-4981-904f-07ed445446aa tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:19.955597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b8f57fd9-8eef-4981-904f-07ed445446aa tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:19.964527 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b8f57fd9-8eef-4981-904f-07ed445446aa tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.964978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b8f57fd9-8eef-4981-904f-07ed445446aa tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:19.965828 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b8f57fd9-8eef-4981-904f-07ed445446aa tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:19.966228 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b8f57fd9-8eef-4981-904f-07ed445446aa tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:20.070614 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b8f57fd9-8eef-4981-904f-07ed445446aa tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121201 Apr 12 14:55:20.071703 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 87/169] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Apr 12 14:55:19 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:20.346535 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cda6af6a-8c1b-49c4-a4a6-f5ef19f31ef0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:20.347503 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cda6af6a-8c1b-49c4-a4a6-f5ef19f31ef0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:20.356211 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cda6af6a-8c1b-49c4-a4a6-f5ef19f31ef0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:20.356667 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cda6af6a-8c1b-49c4-a4a6-f5ef19f31ef0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:20.357543 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cda6af6a-8c1b-49c4-a4a6-f5ef19f31ef0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:20.357996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cda6af6a-8c1b-49c4-a4a6-f5ef19f31ef0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:20.529206 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cda6af6a-8c1b-49c4-a4a6-f5ef19f31ef0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:20.538566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cda6af6a-8c1b-49c4-a4a6-f5ef19f31ef0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:20.540483 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cda6af6a-8c1b-49c4-a4a6-f5ef19f31ef0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:20.541750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cda6af6a-8c1b-49c4-a4a6-f5ef19f31ef0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1598 microversion: 2.20 time: 0.199497 Apr 12 14:55:20.545275 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 83/170] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:55:20 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1598 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:55:20.564616 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-df1dd27a-38e1-4572-8f81-ec45b7e117a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:20.565204 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-df1dd27a-38e1-4572-8f81-ec45b7e117a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:20.571215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df1dd27a-38e1-4572-8f81-ec45b7e117a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:20.572427 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df1dd27a-38e1-4572-8f81-ec45b7e117a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:20.573482 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df1dd27a-38e1-4572-8f81-ec45b7e117a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:20.573970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df1dd27a-38e1-4572-8f81-ec45b7e117a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:20.654330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-df1dd27a-38e1-4572-8f81-ec45b7e117a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091466 Apr 12 14:55:20.654330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 88/171] 10.222.0.64 () {60 vars in 1315 bytes} [Tue Apr 12 14:55:20 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:55:20.792429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c7135e19-7814-4bab-9513-09c13bd9f273 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:20.793545 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c7135e19-7814-4bab-9513-09c13bd9f273 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:20.800693 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7135e19-7814-4bab-9513-09c13bd9f273 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:20.801599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7135e19-7814-4bab-9513-09c13bd9f273 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:20.802011 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4538e5b2-dd3f-4be3-b8d8-0012f5c7b82a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:20.802736 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4538e5b2-dd3f-4be3-b8d8-0012f5c7b82a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:20.803019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7135e19-7814-4bab-9513-09c13bd9f273 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:20.803607 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7135e19-7814-4bab-9513-09c13bd9f273 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:20.826408 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4538e5b2-dd3f-4be3-b8d8-0012f5c7b82a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:20.826868 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4538e5b2-dd3f-4be3-b8d8-0012f5c7b82a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:20.827651 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4538e5b2-dd3f-4be3-b8d8-0012f5c7b82a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:20.828136 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4538e5b2-dd3f-4be3-b8d8-0012f5c7b82a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:21.149092 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c7135e19-7814-4bab-9513-09c13bd9f273 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:21.153321 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4538e5b2-dd3f-4be3-b8d8-0012f5c7b82a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:21.162159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c7135e19-7814-4bab-9513-09c13bd9f273 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1553 microversion: 2.1 time: 0.376013 Apr 12 14:55:21.170601 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4538e5b2-dd3f-4be3-b8d8-0012f5c7b82a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1517 microversion: 2.1 time: 0.377097 Apr 12 14:55:21.174032 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 89/172] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:20 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1517 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:21.174310 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 84/173] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:20 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1553 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:21.194496 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-83d1a752-f945-47a4-b340-ef1cada4d2c8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:21.195633 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-83d1a752-f945-47a4-b340-ef1cada4d2c8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:21.202854 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83d1a752-f945-47a4-b340-ef1cada4d2c8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:21.203402 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83d1a752-f945-47a4-b340-ef1cada4d2c8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:21.204251 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83d1a752-f945-47a4-b340-ef1cada4d2c8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:21.204745 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83d1a752-f945-47a4-b340-ef1cada4d2c8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:21.238081 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-83d1a752-f945-47a4-b340-ef1cada4d2c8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lazy-loading 'flavor' on Instance uuid 71207994-1780-4e45-b693-8455d8038f21 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:55:21.440302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-3f9fdb65-d6ae-4b57-b02d-7bacfaffcdf4 req-9bd7baad-933f-4cdf-90e1-5b6b115d2c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e10895-454d-437b-9325-591ccaa80da9", "tag": "83c56c7d-fadb-4e42-871f-2399e0153f94"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:21.468418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-3f9fdb65-d6ae-4b57-b02d-7bacfaffcdf4 req-9bd7baad-933f-4cdf-90e1-5b6b115d2c7e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:21.471538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-3f9fdb65-d6ae-4b57-b02d-7bacfaffcdf4 req-9bd7baad-933f-4cdf-90e1-5b6b115d2c7e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:21.494133 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-3f9fdb65-d6ae-4b57-b02d-7bacfaffcdf4 req-9bd7baad-933f-4cdf-90e1-5b6b115d2c7e service nova] Creating event network-changed:83c56c7d-fadb-4e42-871f-2399e0153f94 for instance e2e10895-454d-437b-9325-591ccaa80da9 on hv-cinder-83752 Apr 12 14:55:21.507498 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-3f9fdb65-d6ae-4b57-b02d-7bacfaffcdf4 req-9bd7baad-933f-4cdf-90e1-5b6b115d2c7e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073067 Apr 12 14:55:21.508528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 90/174] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:21.717236 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-83d1a752-f945-47a4-b340-ef1cada4d2c8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21/action" status: 200 len: 32 microversion: 2.1 time: 0.526728 Apr 12 14:55:21.718428 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 85/175] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 14:55:21 2022] POST /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21/action => generated 32 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 14:55:21.728200 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6fa4ea62-6230-405b-a259-ed21da53b89b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:21.729061 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6fa4ea62-6230-405b-a259-ed21da53b89b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:21.736104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6fa4ea62-6230-405b-a259-ed21da53b89b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:21.736600 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6fa4ea62-6230-405b-a259-ed21da53b89b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:21.737607 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6fa4ea62-6230-405b-a259-ed21da53b89b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:21.738069 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6fa4ea62-6230-405b-a259-ed21da53b89b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:22.100898 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6fa4ea62-6230-405b-a259-ed21da53b89b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:22.114086 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6fa4ea62-6230-405b-a259-ed21da53b89b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.389929 Apr 12 14:55:22.114604 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 91/176] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:21 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:22.183974 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6103d53e-e902-4f03-8e3e-52a3cec3649b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:22.184767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6103d53e-e902-4f03-8e3e-52a3cec3649b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:22.191934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6103d53e-e902-4f03-8e3e-52a3cec3649b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:22.192378 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6103d53e-e902-4f03-8e3e-52a3cec3649b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:22.193364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6103d53e-e902-4f03-8e3e-52a3cec3649b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:22.193834 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6103d53e-e902-4f03-8e3e-52a3cec3649b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:22.452101 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6103d53e-e902-4f03-8e3e-52a3cec3649b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:22.461309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6103d53e-e902-4f03-8e3e-52a3cec3649b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1553 microversion: 2.1 time: 0.283497 Apr 12 14:55:22.461704 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 86/177] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:22 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1553 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:22.873210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-8fd12e72-ef8c-4c1f-b92d-80523f32f3d1 req-407ed9a4-1a5f-47e7-af97-914fa3e42da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d03f42e-2d51-459d-ade0-7e6a34283867", "tag": "90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:22.885375 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-8fd12e72-ef8c-4c1f-b92d-80523f32f3d1 req-407ed9a4-1a5f-47e7-af97-914fa3e42da9 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:22.885896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-8fd12e72-ef8c-4c1f-b92d-80523f32f3d1 req-407ed9a4-1a5f-47e7-af97-914fa3e42da9 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:22.897232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-8fd12e72-ef8c-4c1f-b92d-80523f32f3d1 req-407ed9a4-1a5f-47e7-af97-914fa3e42da9 service nova] Creating event network-changed:90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77 for instance 9d03f42e-2d51-459d-ade0-7e6a34283867 on hv-cinder-83752 Apr 12 14:55:22.903125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-8fd12e72-ef8c-4c1f-b92d-80523f32f3d1 req-407ed9a4-1a5f-47e7-af97-914fa3e42da9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033472 Apr 12 14:55:22.904210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 92/178] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:23.132137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a27d38a7-cec6-4171-9cb8-037b75efe7c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:23.132955 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a27d38a7-cec6-4171-9cb8-037b75efe7c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:23.139951 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a27d38a7-cec6-4171-9cb8-037b75efe7c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:23.140408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a27d38a7-cec6-4171-9cb8-037b75efe7c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:23.141253 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a27d38a7-cec6-4171-9cb8-037b75efe7c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:23.141822 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a27d38a7-cec6-4171-9cb8-037b75efe7c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:23.286785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a27d38a7-cec6-4171-9cb8-037b75efe7c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:23.295644 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a27d38a7-cec6-4171-9cb8-037b75efe7c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.167163 Apr 12 14:55:23.296580 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 87/179] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:23 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:23.479842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3fe84639-ac3b-4a37-a72c-6cce6cd187cb tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:23.480847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3fe84639-ac3b-4a37-a72c-6cce6cd187cb tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:23.488002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3fe84639-ac3b-4a37-a72c-6cce6cd187cb tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:23.488452 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3fe84639-ac3b-4a37-a72c-6cce6cd187cb tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:23.489253 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3fe84639-ac3b-4a37-a72c-6cce6cd187cb tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:23.489898 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3fe84639-ac3b-4a37-a72c-6cce6cd187cb tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:23.645908 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3fe84639-ac3b-4a37-a72c-6cce6cd187cb tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:23.656828 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3fe84639-ac3b-4a37-a72c-6cce6cd187cb tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1553 microversion: 2.1 time: 0.181689 Apr 12 14:55:23.657767 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 93/180] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:23 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:24.315179 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-16ff900f-d7fa-49ca-b8f2-2b5f87b34a0e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:24.318573 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-16ff900f-d7fa-49ca-b8f2-2b5f87b34a0e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:24.322861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-16ff900f-d7fa-49ca-b8f2-2b5f87b34a0e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:24.323306 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-16ff900f-d7fa-49ca-b8f2-2b5f87b34a0e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:24.324137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-16ff900f-d7fa-49ca-b8f2-2b5f87b34a0e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:24.324568 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-16ff900f-d7fa-49ca-b8f2-2b5f87b34a0e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:24.486670 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-16ff900f-d7fa-49ca-b8f2-2b5f87b34a0e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:24.494437 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-16ff900f-d7fa-49ca-b8f2-2b5f87b34a0e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.183735 Apr 12 14:55:24.495332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 88/181] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:24 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:24.680336 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8c0ed1d9-b40f-48f0-90af-69f9b3a1c2e9 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:24.681328 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8c0ed1d9-b40f-48f0-90af-69f9b3a1c2e9 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:24.687685 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c0ed1d9-b40f-48f0-90af-69f9b3a1c2e9 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:24.688123 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c0ed1d9-b40f-48f0-90af-69f9b3a1c2e9 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:24.692298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c0ed1d9-b40f-48f0-90af-69f9b3a1c2e9 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:24.692741 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c0ed1d9-b40f-48f0-90af-69f9b3a1c2e9 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:24.826886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8c0ed1d9-b40f-48f0-90af-69f9b3a1c2e9 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:24.835207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8c0ed1d9-b40f-48f0-90af-69f9b3a1c2e9 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1553 microversion: 2.1 time: 0.158931 Apr 12 14:55:24.835783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 94/182] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:24 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:25.515850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d0a52476-6c20-4d31-8ad3-3cc5c3fc311f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:25.517313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d0a52476-6c20-4d31-8ad3-3cc5c3fc311f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:25.545403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0a52476-6c20-4d31-8ad3-3cc5c3fc311f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:25.546154 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0a52476-6c20-4d31-8ad3-3cc5c3fc311f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:25.547627 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0a52476-6c20-4d31-8ad3-3cc5c3fc311f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:25.548252 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0a52476-6c20-4d31-8ad3-3cc5c3fc311f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:25.710434 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d0a52476-6c20-4d31-8ad3-3cc5c3fc311f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:25.718350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d0a52476-6c20-4d31-8ad3-3cc5c3fc311f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.207875 Apr 12 14:55:25.718934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 89/183] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:25 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:25.852229 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d0f07b2a-54e5-496c-b60b-bec49b36d6cd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:25.853411 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d0f07b2a-54e5-496c-b60b-bec49b36d6cd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:25.859459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0f07b2a-54e5-496c-b60b-bec49b36d6cd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:25.859907 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0f07b2a-54e5-496c-b60b-bec49b36d6cd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:25.860669 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0f07b2a-54e5-496c-b60b-bec49b36d6cd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:25.861184 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0f07b2a-54e5-496c-b60b-bec49b36d6cd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:26.032107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d0f07b2a-54e5-496c-b60b-bec49b36d6cd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:26.040548 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d0f07b2a-54e5-496c-b60b-bec49b36d6cd tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1553 microversion: 2.1 time: 0.191912 Apr 12 14:55:26.046319 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 95/184] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:25 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:26.735424 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-197761d1-048c-43e4-ad96-3ea7ca44248a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:26.736393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-197761d1-048c-43e4-ad96-3ea7ca44248a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:26.744659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-197761d1-048c-43e4-ad96-3ea7ca44248a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:26.745119 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-197761d1-048c-43e4-ad96-3ea7ca44248a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:26.745933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-197761d1-048c-43e4-ad96-3ea7ca44248a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:26.746997 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-197761d1-048c-43e4-ad96-3ea7ca44248a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:26.854003 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-029571c5-e8ab-4ee4-b41b-b7f0e47ae314 req-4f56a6bf-2eec-4c0f-8a01-b7a1d7c5ce0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d708580-277c-46d3-9972-57055255f9b9", "name": "network-vif-deleted", "tag": "9f9def6f-5f72-486a-9964-ccea9979c6f0"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:26.869780 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-029571c5-e8ab-4ee4-b41b-b7f0e47ae314 req-4f56a6bf-2eec-4c0f-8a01-b7a1d7c5ce0e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:26.870582 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-029571c5-e8ab-4ee4-b41b-b7f0e47ae314 req-4f56a6bf-2eec-4c0f-8a01-b7a1d7c5ce0e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:26.886258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-029571c5-e8ab-4ee4-b41b-b7f0e47ae314 req-4f56a6bf-2eec-4c0f-8a01-b7a1d7c5ce0e service nova] Creating event network-vif-deleted:9f9def6f-5f72-486a-9964-ccea9979c6f0 for instance 1d708580-277c-46d3-9972-57055255f9b9 on hv-cinder-83752 Apr 12 14:55:26.894779 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-029571c5-e8ab-4ee4-b41b-b7f0e47ae314 req-4f56a6bf-2eec-4c0f-8a01-b7a1d7c5ce0e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047786 Apr 12 14:55:26.894779 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 96/185] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:27.058843 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-89c23b26-c1b2-4e8e-a861-92e27b1dc59b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:27.059558 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-89c23b26-c1b2-4e8e-a861-92e27b1dc59b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:27.080337 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89c23b26-c1b2-4e8e-a861-92e27b1dc59b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:27.081308 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89c23b26-c1b2-4e8e-a861-92e27b1dc59b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:27.082301 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89c23b26-c1b2-4e8e-a861-92e27b1dc59b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:27.083024 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89c23b26-c1b2-4e8e-a861-92e27b1dc59b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:27.187087 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-89c23b26-c1b2-4e8e-a861-92e27b1dc59b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:27.195869 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-89c23b26-c1b2-4e8e-a861-92e27b1dc59b tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1345 microversion: 2.1 time: 0.141686 Apr 12 14:55:27.195869 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 97/186] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:27 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:27.223030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-197761d1-048c-43e4-ad96-3ea7ca44248a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:27.230955 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-197761d1-048c-43e4-ad96-3ea7ca44248a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.499055 Apr 12 14:55:27.231230 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 90/187] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:26 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:28.213548 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:28.218715 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:28.220391 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:28.220901 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:28.221602 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:28.222063 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:28.247850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-56a60439-8860-4c04-976b-3282baf07961 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:28.248467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-56a60439-8860-4c04-976b-3282baf07961 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:28.253357 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:28.253897 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:28.254343 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lazy-loading 'fault' on Instance uuid 1d708580-277c-46d3-9972-57055255f9b9 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:55:28.254544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56a60439-8860-4c04-976b-3282baf07961 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:28.254993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56a60439-8860-4c04-976b-3282baf07961 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:28.257990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56a60439-8860-4c04-976b-3282baf07961 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:28.258451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56a60439-8860-4c04-976b-3282baf07961 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:28.321608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76c3495848448ce9bd3b77af8cbf8db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dc8d68f5f848fc8a1afce6f56d829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:28.330496 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0080409f-87b8-4838-b746-0007d5c3a4f2 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 200 len: 1350 microversion: 2.1 time: 0.121128 Apr 12 14:55:28.338013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 98/188] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:28 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 1350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:28.421984 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-56a60439-8860-4c04-976b-3282baf07961 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:28.429934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-56a60439-8860-4c04-976b-3282baf07961 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.185776 Apr 12 14:55:28.430597 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 91/189] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:28 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:29.353586 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-28266581-3e37-4ebb-9836-2c9b188b3b13 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:29.354244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-28266581-3e37-4ebb-9836-2c9b188b3b13 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:29.360937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-28266581-3e37-4ebb-9836-2c9b188b3b13 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:29.361490 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-28266581-3e37-4ebb-9836-2c9b188b3b13 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:29.362321 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-28266581-3e37-4ebb-9836-2c9b188b3b13 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:29.362749 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-28266581-3e37-4ebb-9836-2c9b188b3b13 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:29.377983 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-28266581-3e37-4ebb-9836-2c9b188b3b13 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] HTTP exception thrown: Instance 1d708580-277c-46d3-9972-57055255f9b9 could not be found. Apr 12 14:55:29.378573 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-28266581-3e37-4ebb-9836-2c9b188b3b13 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Returning 404 to user: Instance 1d708580-277c-46d3-9972-57055255f9b9 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:55:29.379393 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-28266581-3e37-4ebb-9836-2c9b188b3b13 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 404 len: 111 microversion: 2.1 time: 0.030808 Apr 12 14:55:29.379926 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 99/190] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:29 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:55:29.455347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6a413c77-f1f9-4564-bad7-f9d60cbac094 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:29.456215 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6a413c77-f1f9-4564-bad7-f9d60cbac094 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:29.465906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6a413c77-f1f9-4564-bad7-f9d60cbac094 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:29.466542 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6a413c77-f1f9-4564-bad7-f9d60cbac094 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:29.467333 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6a413c77-f1f9-4564-bad7-f9d60cbac094 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:29.467759 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6a413c77-f1f9-4564-bad7-f9d60cbac094 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:29.495651 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4e7f5e54-6dba-4e0f-bfc3-11a3c6bea8ac tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:29.496578 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4e7f5e54-6dba-4e0f-bfc3-11a3c6bea8ac tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:29.503341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e7f5e54-6dba-4e0f-bfc3-11a3c6bea8ac tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:29.503959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e7f5e54-6dba-4e0f-bfc3-11a3c6bea8ac tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:29.504899 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e7f5e54-6dba-4e0f-bfc3-11a3c6bea8ac tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:29.505475 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e7f5e54-6dba-4e0f-bfc3-11a3c6bea8ac tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:29.521167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-4e7f5e54-6dba-4e0f-bfc3-11a3c6bea8ac tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] HTTP exception thrown: Instance 1d708580-277c-46d3-9972-57055255f9b9 could not be found. Apr 12 14:55:29.527547 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4e7f5e54-6dba-4e0f-bfc3-11a3c6bea8ac tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Returning 404 to user: Instance 1d708580-277c-46d3-9972-57055255f9b9 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:55:29.527547 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4e7f5e54-6dba-4e0f-bfc3-11a3c6bea8ac tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033071 Apr 12 14:55:29.528169 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 100/191] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:55:29 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:55:29.652749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6a413c77-f1f9-4564-bad7-f9d60cbac094 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:29.660278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6a413c77-f1f9-4564-bad7-f9d60cbac094 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.209419 Apr 12 14:55:29.660787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 92/192] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:29 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:30.677648 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-65f217a2-86b0-43bf-bb1f-dc693d84569c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:30.678381 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-65f217a2-86b0-43bf-bb1f-dc693d84569c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:30.685879 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-65f217a2-86b0-43bf-bb1f-dc693d84569c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:30.686335 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-65f217a2-86b0-43bf-bb1f-dc693d84569c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:30.687185 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-65f217a2-86b0-43bf-bb1f-dc693d84569c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:30.687658 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-65f217a2-86b0-43bf-bb1f-dc693d84569c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:30.872562 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-65f217a2-86b0-43bf-bb1f-dc693d84569c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:30.880112 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-65f217a2-86b0-43bf-bb1f-dc693d84569c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.206492 Apr 12 14:55:30.880815 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 101/193] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:30 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:30.970282 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3b5d8c43-e6dd-46b7-b054-a825897ee092 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:30.978977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3b5d8c43-e6dd-46b7-b054-a825897ee092 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:30.978977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3b5d8c43-e6dd-46b7-b054-a825897ee092 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:30.978977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3b5d8c43-e6dd-46b7-b054-a825897ee092 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:30.979649 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3b5d8c43-e6dd-46b7-b054-a825897ee092 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:30.980137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3b5d8c43-e6dd-46b7-b054-a825897ee092 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:30.996296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-3b5d8c43-e6dd-46b7-b054-a825897ee092 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] HTTP exception thrown: Instance 1d708580-277c-46d3-9972-57055255f9b9 could not be found. Apr 12 14:55:30.996874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3b5d8c43-e6dd-46b7-b054-a825897ee092 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Returning 404 to user: Instance 1d708580-277c-46d3-9972-57055255f9b9 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:55:30.997712 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3b5d8c43-e6dd-46b7-b054-a825897ee092 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 404 len: 111 microversion: 2.1 time: 0.031507 Apr 12 14:55:31.000993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 93/194] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 14:55:30 2022] DELETE /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:55:31.006474 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-efbc2a96-8e06-4aa6-8d0b-5ff33ed4e5f1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:31.007086 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-efbc2a96-8e06-4aa6-8d0b-5ff33ed4e5f1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] [instance: 1d708580-277c-46d3-9972-57055255f9b9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:31.014427 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efbc2a96-8e06-4aa6-8d0b-5ff33ed4e5f1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:31.014427 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efbc2a96-8e06-4aa6-8d0b-5ff33ed4e5f1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:31.015532 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efbc2a96-8e06-4aa6-8d0b-5ff33ed4e5f1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:31.015532 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efbc2a96-8e06-4aa6-8d0b-5ff33ed4e5f1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:31.031359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-efbc2a96-8e06-4aa6-8d0b-5ff33ed4e5f1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] HTTP exception thrown: Instance 1d708580-277c-46d3-9972-57055255f9b9 could not be found. Apr 12 14:55:31.031986 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-efbc2a96-8e06-4aa6-8d0b-5ff33ed4e5f1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] Returning 404 to user: Instance 1d708580-277c-46d3-9972-57055255f9b9 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:55:31.033365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-efbc2a96-8e06-4aa6-8d0b-5ff33ed4e5f1 tempest-DeleteServersTestJSON-1946837409 tempest-DeleteServersTestJSON-1946837409-project] 10.222.0.64 "GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9" status: 404 len: 111 microversion: 2.1 time: 0.030727 Apr 12 14:55:31.034544 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 102/195] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:31 2022] GET /compute/v2.1/servers/1d708580-277c-46d3-9972-57055255f9b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:55:31.899311 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9053a39a-ce85-4412-8021-171c65a8fb80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:31.901673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9053a39a-ce85-4412-8021-171c65a8fb80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:31.908358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9053a39a-ce85-4412-8021-171c65a8fb80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:31.909412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9053a39a-ce85-4412-8021-171c65a8fb80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:31.910789 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9053a39a-ce85-4412-8021-171c65a8fb80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:31.911439 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9053a39a-ce85-4412-8021-171c65a8fb80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:32.070373 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9053a39a-ce85-4412-8021-171c65a8fb80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:32.083438 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9053a39a-ce85-4412-8021-171c65a8fb80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.188450 Apr 12 14:55:32.091386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 94/196] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:31 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:33.103858 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2639899d-491b-4520-8959-22b22090b71a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:33.105511 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2639899d-491b-4520-8959-22b22090b71a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:33.112168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2639899d-491b-4520-8959-22b22090b71a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:33.112882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2639899d-491b-4520-8959-22b22090b71a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:33.115369 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2639899d-491b-4520-8959-22b22090b71a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:33.115369 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2639899d-491b-4520-8959-22b22090b71a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:33.265902 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2639899d-491b-4520-8959-22b22090b71a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:33.275574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2639899d-491b-4520-8959-22b22090b71a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.176092 Apr 12 14:55:33.278591 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 103/197] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:33 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:34.293204 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6d8d45c2-f5c3-449f-8029-1744432acd60 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:34.293839 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6d8d45c2-f5c3-449f-8029-1744432acd60 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:34.300051 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d8d45c2-f5c3-449f-8029-1744432acd60 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:34.300423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d8d45c2-f5c3-449f-8029-1744432acd60 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:34.301203 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d8d45c2-f5c3-449f-8029-1744432acd60 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:34.301621 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d8d45c2-f5c3-449f-8029-1744432acd60 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:34.448566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6d8d45c2-f5c3-449f-8029-1744432acd60 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:34.458308 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6d8d45c2-f5c3-449f-8029-1744432acd60 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.168877 Apr 12 14:55:34.458796 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 95/198] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:34 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:35.141144 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c6f0b7d1-91c2-45be-8969-ede56b73b6e8 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Action: 'create', calling method: .version_select at 0x7fbd60ad1dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-794631362"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:35.480490 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e3aeeedb-30f4-4df2-a765-a428f52ea1d3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:35.481815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e3aeeedb-30f4-4df2-a765-a428f52ea1d3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:35.494972 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e3aeeedb-30f4-4df2-a765-a428f52ea1d3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:35.496622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e3aeeedb-30f4-4df2-a765-a428f52ea1d3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:35.498185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e3aeeedb-30f4-4df2-a765-a428f52ea1d3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:35.499399 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e3aeeedb-30f4-4df2-a765-a428f52ea1d3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:35.739914 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e3aeeedb-30f4-4df2-a765-a428f52ea1d3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:35.751358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e3aeeedb-30f4-4df2-a765-a428f52ea1d3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.278580 Apr 12 14:55:35.751955 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 96/199] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:35 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:35.917214 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c6f0b7d1-91c2-45be-8969-ede56b73b6e8 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.967647 Apr 12 14:55:35.923899 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 104/200] 10.222.0.64 () {60 vars in 1154 bytes} [Tue Apr 12 14:55:34 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 969 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 12 14:55:35.929187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-48de74ce-bc61-4c35-a9fb-984ddb70a54d tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd60c5c1f0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:35.996116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-48de74ce-bc61-4c35-a9fb-984ddb70a54d tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3" status: 200 len: 344 microversion: 2.1 time: 0.064328 Apr 12 14:55:35.996116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 97/201] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:55:35 2022] GET /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:36.773277 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c6b0e679-cb60-4f77-ab14-671768443a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:36.773925 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c6b0e679-cb60-4f77-ab14-671768443a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:36.781442 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6b0e679-cb60-4f77-ab14-671768443a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:36.781917 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6b0e679-cb60-4f77-ab14-671768443a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:36.788725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6b0e679-cb60-4f77-ab14-671768443a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:36.788725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6b0e679-cb60-4f77-ab14-671768443a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:36.974112 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c6b0e679-cb60-4f77-ab14-671768443a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:36.986602 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c6b0e679-cb60-4f77-ab14-671768443a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.221260 Apr 12 14:55:36.997618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 105/202] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:36 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:37.003866 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d40383ff-6bc1-4f00-8a16-12be06f7d200 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd6148e0d0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:37.085278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d40383ff-6bc1-4f00-8a16-12be06f7d200 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3" status: 200 len: 345 microversion: 2.1 time: 0.085433 Apr 12 14:55:37.085893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 98/203] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:55:36 2022] GET /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3 => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:37.097013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-80c531ec-b5be-4ec1-9f74-4269862dac71 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Action: 'create', calling method: .version_select at 0x7fbd60b80ca0>, body: {"snapshot": {"volume_id": "5a42f6bd-f833-4686-a39f-f904a2e136d3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1886574229"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:55:37.601117 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-80c531ec-b5be-4ec1-9f74-4269862dac71 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.506948 Apr 12 14:55:37.601117 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 106/204] 10.222.0.64 () {60 vars in 1161 bytes} [Tue Apr 12 14:55:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:37.611305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-58e55a2d-2b16-4354-82e9-73e61f1102be tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd6148e8b0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:37.642618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-58e55a2d-2b16-4354-82e9-73e61f1102be tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36" status: 200 len: 287 microversion: 2.1 time: 0.035067 Apr 12 14:55:37.643325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 99/205] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Apr 12 14:55:37 2022] GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:37.653872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0d621018-5a81-4ad7-b06e-1fa17aae9e58 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd60ad1160>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:37.685168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0d621018-5a81-4ad7-b06e-1fa17aae9e58 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035805 Apr 12 14:55:37.687316 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 107/206] 10.222.0.64 () {58 vars in 1139 bytes} [Tue Apr 12 14:55:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:37.698947 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e10a084c-7f50-431d-b626-fbeede4e73ff tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd60c5c1f0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:37.728706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e10a084c-7f50-431d-b626-fbeede4e73ff tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36" status: 200 len: 287 microversion: 2.1 time: 0.034766 Apr 12 14:55:37.729290 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 100/207] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Apr 12 14:55:37 2022] GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:38.005892 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7a254d2a-7eb7-4a45-b951-525855212715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:38.007108 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7a254d2a-7eb7-4a45-b951-525855212715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:38.013515 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7a254d2a-7eb7-4a45-b951-525855212715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:38.013989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7a254d2a-7eb7-4a45-b951-525855212715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:38.014763 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7a254d2a-7eb7-4a45-b951-525855212715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:38.015196 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7a254d2a-7eb7-4a45-b951-525855212715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:38.182757 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7a254d2a-7eb7-4a45-b951-525855212715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:38.190564 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7a254d2a-7eb7-4a45-b951-525855212715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.189123 Apr 12 14:55:38.191124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 108/208] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:37 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:38.740104 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-43356582-fd9e-45bf-a2c7-c9e0e580bc39 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd614a8c10>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:38.778458 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-43356582-fd9e-45bf-a2c7-c9e0e580bc39 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36" status: 200 len: 287 microversion: 2.1 time: 0.042009 Apr 12 14:55:38.779027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 101/209] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Apr 12 14:55:38 2022] GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:39.209147 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-729edda2-8f21-473d-a9a9-ab3df65cfa00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:39.209736 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-729edda2-8f21-473d-a9a9-ab3df65cfa00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:39.216786 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-729edda2-8f21-473d-a9a9-ab3df65cfa00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:39.217236 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-729edda2-8f21-473d-a9a9-ab3df65cfa00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:39.218027 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-729edda2-8f21-473d-a9a9-ab3df65cfa00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:39.218456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-729edda2-8f21-473d-a9a9-ab3df65cfa00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:39.352161 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-729edda2-8f21-473d-a9a9-ab3df65cfa00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:39.360748 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-729edda2-8f21-473d-a9a9-ab3df65cfa00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.155387 Apr 12 14:55:39.361320 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 109/210] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:39 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:39.791362 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-63cbc18b-b1af-45f4-8bc8-9da793ef6dd7 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd6148e1f0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:39.824856 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-63cbc18b-b1af-45f4-8bc8-9da793ef6dd7 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36" status: 200 len: 287 microversion: 2.1 time: 0.036433 Apr 12 14:55:39.824856 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 102/211] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Apr 12 14:55:39 2022] GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:40.379436 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b577eff4-a774-4146-b95b-61d3e980c285 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:40.380107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b577eff4-a774-4146-b95b-61d3e980c285 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:40.387199 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b577eff4-a774-4146-b95b-61d3e980c285 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:40.387640 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b577eff4-a774-4146-b95b-61d3e980c285 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:40.388414 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b577eff4-a774-4146-b95b-61d3e980c285 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:40.388872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b577eff4-a774-4146-b95b-61d3e980c285 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:40.568669 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b577eff4-a774-4146-b95b-61d3e980c285 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:40.577820 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b577eff4-a774-4146-b95b-61d3e980c285 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.202349 Apr 12 14:55:40.578403 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 110/212] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:40 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:40.834890 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f59a0101-848f-4e2b-88bc-c2f9fb057f47 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd6148e790>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:40.864535 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f59a0101-848f-4e2b-88bc-c2f9fb057f47 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36" status: 200 len: 287 microversion: 2.1 time: 0.033429 Apr 12 14:55:40.865133 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 103/213] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Apr 12 14:55:40 2022] GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:41.595422 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-736b7969-ccd3-4d62-8e3a-c13a1d37d566 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:41.596189 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-736b7969-ccd3-4d62-8e3a-c13a1d37d566 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:41.607486 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-736b7969-ccd3-4d62-8e3a-c13a1d37d566 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:41.608418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-736b7969-ccd3-4d62-8e3a-c13a1d37d566 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:41.609299 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-736b7969-ccd3-4d62-8e3a-c13a1d37d566 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:41.609813 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-736b7969-ccd3-4d62-8e3a-c13a1d37d566 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:41.747569 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-736b7969-ccd3-4d62-8e3a-c13a1d37d566 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:41.756590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-736b7969-ccd3-4d62-8e3a-c13a1d37d566 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.165041 Apr 12 14:55:41.757553 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 111/214] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:41 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:41.876259 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f59b1fdd-8d67-4b1e-99d6-8a394829e8fb tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd6148e160>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:41.910881 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f59b1fdd-8d67-4b1e-99d6-8a394829e8fb tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36" status: 200 len: 288 microversion: 2.1 time: 0.037867 Apr 12 14:55:41.911611 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 104/215] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Apr 12 14:55:41 2022] GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:41.922535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0ae06276-78c3-419d-8e5a-7b805bc25c3b tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd60b62940>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:42.083127 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0ae06276-78c3-419d-8e5a-7b805bc25c3b tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36" status: 202 len: 0 microversion: 2.1 time: 0.164639 Apr 12 14:55:42.083915 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 112/216] 10.222.0.64 () {58 vars in 1253 bytes} [Tue Apr 12 14:55:41 2022] DELETE /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:55:42.093716 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-02320a10-8f1a-4d24-b0c3-853265710bed tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd614a81f0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:42.126580 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-02320a10-8f1a-4d24-b0c3-853265710bed tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36" status: 200 len: 287 microversion: 2.1 time: 0.037312 Apr 12 14:55:42.128094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 105/217] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Apr 12 14:55:42 2022] GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:42.776470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3f887f64-e3b8-4a69-9b5c-ef50e1090c00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:42.777153 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3f887f64-e3b8-4a69-9b5c-ef50e1090c00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:42.782980 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3f887f64-e3b8-4a69-9b5c-ef50e1090c00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:42.783426 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3f887f64-e3b8-4a69-9b5c-ef50e1090c00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:42.784223 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3f887f64-e3b8-4a69-9b5c-ef50e1090c00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:42.784586 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3f887f64-e3b8-4a69-9b5c-ef50e1090c00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:42.929300 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3f887f64-e3b8-4a69-9b5c-ef50e1090c00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:42.937959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3f887f64-e3b8-4a69-9b5c-ef50e1090c00 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.167065 Apr 12 14:55:42.938799 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 113/218] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:42 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:43.138963 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-12f67969-5e6e-4f69-b677-d0bc88df040b tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd60c5cb80>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:43.166262 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-12f67969-5e6e-4f69-b677-d0bc88df040b tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] HTTP exception thrown: Snapshot 86125da2-fd32-45f4-b9d5-457af8c5be36 could not be found. Apr 12 14:55:43.166891 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-12f67969-5e6e-4f69-b677-d0bc88df040b tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Returning 404 to user: Snapshot 86125da2-fd32-45f4-b9d5-457af8c5be36 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:55:43.167713 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-12f67969-5e6e-4f69-b677-d0bc88df040b tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36" status: 404 len: 111 microversion: 2.1 time: 0.032985 Apr 12 14:55:43.168282 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 106/219] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Apr 12 14:55:43 2022] GET /compute/v2.1/os-snapshots/86125da2-fd32-45f4-b9d5-457af8c5be36 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:55:43.176736 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f44a62e6-6afd-4625-a128-93781d6365c3 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd60b9fe50>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:43.445532 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f44a62e6-6afd-4625-a128-93781d6365c3 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3" status: 202 len: 0 microversion: 2.1 time: 0.272824 Apr 12 14:55:43.446240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 114/220] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Apr 12 14:55:43 2022] DELETE /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:55:43.454961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-41e3238d-de92-4f9c-a7aa-571e14447528 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd6148e040>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:43.502335 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-41e3238d-de92-4f9c-a7aa-571e14447528 tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3" status: 200 len: 344 microversion: 2.1 time: 0.051704 Apr 12 14:55:43.502906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 107/221] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:55:43 2022] GET /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:43.957847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-367bbbd2-ec56-469f-9c3d-43bf3b27f719 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:43.958550 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-367bbbd2-ec56-469f-9c3d-43bf3b27f719 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:43.967194 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-367bbbd2-ec56-469f-9c3d-43bf3b27f719 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:43.969484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-367bbbd2-ec56-469f-9c3d-43bf3b27f719 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:43.969484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-367bbbd2-ec56-469f-9c3d-43bf3b27f719 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:43.971795 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-367bbbd2-ec56-469f-9c3d-43bf3b27f719 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:44.147411 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-367bbbd2-ec56-469f-9c3d-43bf3b27f719 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:44.152695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-367bbbd2-ec56-469f-9c3d-43bf3b27f719 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.200691 Apr 12 14:55:44.153587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 115/222] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:43 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:44.515759 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-17ec5372-05a8-4e6c-9511-17dbc840e54a tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd6148e700>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:44.812710 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-17ec5372-05a8-4e6c-9511-17dbc840e54a tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] HTTP exception thrown: Volume 5a42f6bd-f833-4686-a39f-f904a2e136d3 could not be found. Apr 12 14:55:44.812710 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-17ec5372-05a8-4e6c-9511-17dbc840e54a tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Returning 404 to user: Volume 5a42f6bd-f833-4686-a39f-f904a2e136d3 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:55:44.813156 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-17ec5372-05a8-4e6c-9511-17dbc840e54a tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3" status: 404 len: 109 microversion: 2.1 time: 0.301483 Apr 12 14:55:44.813720 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 108/223] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:55:44 2022] GET /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3 => generated 109 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:55:44.823428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9dadc3d6-96ba-4b5a-aac2-3cf4577a310f tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd60b629d0>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:44.871642 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-9dadc3d6-96ba-4b5a-aac2-3cf4577a310f tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] HTTP exception thrown: Volume 5a42f6bd-f833-4686-a39f-f904a2e136d3 could not be found. Apr 12 14:55:44.872329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9dadc3d6-96ba-4b5a-aac2-3cf4577a310f tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Returning 404 to user: Volume 5a42f6bd-f833-4686-a39f-f904a2e136d3 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:55:44.873264 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9dadc3d6-96ba-4b5a-aac2-3cf4577a310f tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3" status: 404 len: 109 microversion: 2.1 time: 0.053832 Apr 12 14:55:44.876856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 116/224] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Apr 12 14:55:44 2022] DELETE /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 14:55:44.886654 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-811a1a9d-63ab-4975-83e1-50da27aa64cd tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Calling method '.version_select at 0x7fbd60c5c940>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:44.921071 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-811a1a9d-63ab-4975-83e1-50da27aa64cd tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] HTTP exception thrown: Volume 5a42f6bd-f833-4686-a39f-f904a2e136d3 could not be found. Apr 12 14:55:44.921988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-811a1a9d-63ab-4975-83e1-50da27aa64cd tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] Returning 404 to user: Volume 5a42f6bd-f833-4686-a39f-f904a2e136d3 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:55:44.922916 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-811a1a9d-63ab-4975-83e1-50da27aa64cd tempest-VolumesSnapshotsTestJSON-1066342913 tempest-VolumesSnapshotsTestJSON-1066342913-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3" status: 404 len: 109 microversion: 2.1 time: 0.044060 Apr 12 14:55:44.923801 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 109/225] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:55:44 2022] GET /compute/v2.1/os-volumes/5a42f6bd-f833-4686-a39f-f904a2e136d3 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:55:45.170814 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b72f537c-e617-42d1-988d-1a3bca5c7a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:45.172367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b72f537c-e617-42d1-988d-1a3bca5c7a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:45.182376 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b72f537c-e617-42d1-988d-1a3bca5c7a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:45.182856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b72f537c-e617-42d1-988d-1a3bca5c7a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:45.185542 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b72f537c-e617-42d1-988d-1a3bca5c7a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:45.185542 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b72f537c-e617-42d1-988d-1a3bca5c7a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:45.350215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b72f537c-e617-42d1-988d-1a3bca5c7a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:45.359210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b72f537c-e617-42d1-988d-1a3bca5c7a15 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.193596 Apr 12 14:55:45.360782 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 117/226] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:45 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:46.380618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e9cb8f51-b024-4d7e-aaf2-f2dd3d3dcc76 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:46.383153 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e9cb8f51-b024-4d7e-aaf2-f2dd3d3dcc76 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:46.389178 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e9cb8f51-b024-4d7e-aaf2-f2dd3d3dcc76 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:46.389646 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e9cb8f51-b024-4d7e-aaf2-f2dd3d3dcc76 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:46.390417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e9cb8f51-b024-4d7e-aaf2-f2dd3d3dcc76 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:46.390843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e9cb8f51-b024-4d7e-aaf2-f2dd3d3dcc76 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:46.566585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e9cb8f51-b024-4d7e-aaf2-f2dd3d3dcc76 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:46.575234 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e9cb8f51-b024-4d7e-aaf2-f2dd3d3dcc76 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.199658 Apr 12 14:55:46.575820 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 110/227] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:46 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:47.593485 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b77df1c1-00db-4ab1-8ab4-c70528cad77b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:47.594119 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b77df1c1-00db-4ab1-8ab4-c70528cad77b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:47.603978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b77df1c1-00db-4ab1-8ab4-c70528cad77b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:47.604424 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b77df1c1-00db-4ab1-8ab4-c70528cad77b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:47.605345 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b77df1c1-00db-4ab1-8ab4-c70528cad77b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:47.605859 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b77df1c1-00db-4ab1-8ab4-c70528cad77b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:47.754603 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b77df1c1-00db-4ab1-8ab4-c70528cad77b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:47.763066 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b77df1c1-00db-4ab1-8ab4-c70528cad77b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.173932 Apr 12 14:55:47.763631 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 118/228] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:47 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:48.780435 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-81ac9667-5725-447f-bd88-192b447fb154 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:48.781072 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-81ac9667-5725-447f-bd88-192b447fb154 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:48.787565 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81ac9667-5725-447f-bd88-192b447fb154 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:48.788020 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81ac9667-5725-447f-bd88-192b447fb154 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:48.788799 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81ac9667-5725-447f-bd88-192b447fb154 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:48.789253 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81ac9667-5725-447f-bd88-192b447fb154 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:48.925342 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-baf1bd60-cc10-499b-a2bd-d976d66d0caf tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd60b623a0>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:48.963725 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-81ac9667-5725-447f-bd88-192b447fb154 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:48.977880 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-81ac9667-5725-447f-bd88-192b447fb154 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.199718 Apr 12 14:55:48.986090 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-baf1bd60-cc10-499b-a2bd-d976d66d0caf tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e0b269a8-55b6-4b43-be8d-4a32f2e5e31d" status: 200 len: 351 microversion: 2.1 time: 0.068006 Apr 12 14:55:48.986811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 119/229] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:55:48 2022] GET /compute/v2.1/os-volumes/e0b269a8-55b6-4b43-be8d-4a32f2e5e31d => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:48.990455 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 111/230] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:48 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:49.996774 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2e914b84-a020-408a-b088-a8fe566e3912 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:49.997316 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2e914b84-a020-408a-b088-a8fe566e3912 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:50.005772 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e914b84-a020-408a-b088-a8fe566e3912 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:50.006470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e914b84-a020-408a-b088-a8fe566e3912 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:50.007599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e914b84-a020-408a-b088-a8fe566e3912 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:50.008166 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e914b84-a020-408a-b088-a8fe566e3912 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:50.148675 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2e914b84-a020-408a-b088-a8fe566e3912 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:50.156793 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2e914b84-a020-408a-b088-a8fe566e3912 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.164947 Apr 12 14:55:50.157459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 120/231] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:49 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:50.573559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e27d04c2-8a78-4b84-8be1-074853422ba0 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd60c5cee0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:50.626352 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e27d04c2-8a78-4b84-8be1-074853422ba0 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/b0931b99-1393-46fa-860b-d034d1a02a8c" status: 200 len: 350 microversion: 2.1 time: 0.056741 Apr 12 14:55:50.626925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 112/232] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:55:50 2022] GET /compute/v2.1/os-volumes/b0931b99-1393-46fa-860b-d034d1a02a8c => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:51.179181 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9fb2fb46-79d0-4a54-b01b-401076937db7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:51.179794 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9fb2fb46-79d0-4a54-b01b-401076937db7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:51.187326 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9fb2fb46-79d0-4a54-b01b-401076937db7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:51.187784 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9fb2fb46-79d0-4a54-b01b-401076937db7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:51.189911 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9fb2fb46-79d0-4a54-b01b-401076937db7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:51.189911 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9fb2fb46-79d0-4a54-b01b-401076937db7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:51.381760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9fb2fb46-79d0-4a54-b01b-401076937db7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:51.390494 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9fb2fb46-79d0-4a54-b01b-401076937db7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.215214 Apr 12 14:55:51.392678 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 121/233] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:51 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:52.378725 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5199e0fa-6224-475b-9616-1f35a84d2bd8 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd625daee0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:52.418531 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2c3177d3-120c-4656-818c-e32552ed9959 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:52.419321 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2c3177d3-120c-4656-818c-e32552ed9959 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:52.428018 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c3177d3-120c-4656-818c-e32552ed9959 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:52.429031 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c3177d3-120c-4656-818c-e32552ed9959 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:52.433667 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c3177d3-120c-4656-818c-e32552ed9959 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:52.433667 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c3177d3-120c-4656-818c-e32552ed9959 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:52.441982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5199e0fa-6224-475b-9616-1f35a84d2bd8 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e8887f00-ebc7-4f11-8cb8-f5262852cca1" status: 200 len: 350 microversion: 2.1 time: 0.067614 Apr 12 14:55:52.442958 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 113/234] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:55:52 2022] GET /compute/v2.1/os-volumes/e8887f00-ebc7-4f11-8cb8-f5262852cca1 => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:52.456679 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-145f2a63-37ce-4cde-91a4-ba1deeaaab1e tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd6148e0d0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:52.563833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-145f2a63-37ce-4cde-91a4-ba1deeaaab1e tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.112920 Apr 12 14:55:52.564436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 114/235] 10.222.0.64 () {58 vars in 1133 bytes} [Tue Apr 12 14:55:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:52.577041 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-90a8430b-b2e4-4cd9-8161-95cd455ff9e3 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd63032f70>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:52.624464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2c3177d3-120c-4656-818c-e32552ed9959 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:52.631934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2c3177d3-120c-4656-818c-e32552ed9959 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.220605 Apr 12 14:55:52.646504 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 122/236] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:52 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:52.681134 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-90a8430b-b2e4-4cd9-8161-95cd455ff9e3 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.105767 Apr 12 14:55:52.681134 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 115/237] 10.222.0.64 () {58 vars in 1148 bytes} [Tue Apr 12 14:55:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:52.691874 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ef90f1e7-dee4-465d-8356-10db7b5a0347 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd60b62820>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:52.781282 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ef90f1e7-dee4-465d-8356-10db7b5a0347 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.093333 Apr 12 14:55:52.788655 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 123/238] 10.222.0.64 () {58 vars in 1133 bytes} [Tue Apr 12 14:55:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:52.794184 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8bdf6510-614f-4049-a358-3b94819511f1 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd6149b0d0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:52.894319 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8bdf6510-614f-4049-a358-3b94819511f1 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104423 Apr 12 14:55:52.895116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 116/239] 10.222.0.64 () {58 vars in 1166 bytes} [Tue Apr 12 14:55:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:55:52.911714 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c3cb8950-8100-4631-b103-c318477a98c0 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd625af1f0>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:53.013576 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c3cb8950-8100-4631-b103-c318477a98c0 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.108582 Apr 12 14:55:53.014369 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 124/240] 10.222.0.64 () {58 vars in 1169 bytes} [Tue Apr 12 14:55:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:53.029569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-758fd47a-a6d9-4644-830f-ec49db46416e tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd614a89d0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:53.130318 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-758fd47a-a6d9-4644-830f-ec49db46416e tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.104678 Apr 12 14:55:53.131146 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 117/241] 10.222.0.64 () {58 vars in 1154 bytes} [Tue Apr 12 14:55:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:53.144064 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e6dce862-0118-4328-a9a4-bff5b8d9ce16 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd60b9f1f0>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:53.244248 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e6dce862-0118-4328-a9a4-bff5b8d9ce16 tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105221 Apr 12 14:55:53.245650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 125/242] 10.222.0.64 () {58 vars in 1187 bytes} [Tue Apr 12 14:55:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:53.257109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0f007058-d8d7-415d-a467-2019887d000a tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] Calling method '.version_select at 0x7fbd6149b0d0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:53.347726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0f007058-d8d7-415d-a467-2019887d000a tempest-VolumesTestJSON-1261166223 tempest-VolumesTestJSON-1261166223-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.094283 Apr 12 14:55:53.348918 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 118/243] 10.222.0.64 () {58 vars in 1154 bytes} [Tue Apr 12 14:55:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:53.650964 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-24b3c977-a5bf-4075-90d2-2a3add904c9e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:53.651509 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-24b3c977-a5bf-4075-90d2-2a3add904c9e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:53.657563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-24b3c977-a5bf-4075-90d2-2a3add904c9e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:53.658038 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-24b3c977-a5bf-4075-90d2-2a3add904c9e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:53.658806 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-24b3c977-a5bf-4075-90d2-2a3add904c9e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:53.659238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-24b3c977-a5bf-4075-90d2-2a3add904c9e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:53.811289 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-24b3c977-a5bf-4075-90d2-2a3add904c9e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:53.821588 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-24b3c977-a5bf-4075-90d2-2a3add904c9e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.174827 Apr 12 14:55:53.822207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 126/244] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:53 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:55:54.845416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f42316dd-0024-4058-ab1d-18bd6df2429e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:54.846158 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f42316dd-0024-4058-ab1d-18bd6df2429e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:54.852888 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f42316dd-0024-4058-ab1d-18bd6df2429e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:54.853340 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f42316dd-0024-4058-ab1d-18bd6df2429e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:54.854138 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f42316dd-0024-4058-ab1d-18bd6df2429e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:54.854845 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f42316dd-0024-4058-ab1d-18bd6df2429e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:55.002301 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f42316dd-0024-4058-ab1d-18bd6df2429e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:55.010663 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f42316dd-0024-4058-ab1d-18bd6df2429e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.169855 Apr 12 14:55:55.012758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 119/245] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:54 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:56.033948 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b9fc043e-30ba-4595-ba81-52f07c0f458e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:56.034605 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b9fc043e-30ba-4595-ba81-52f07c0f458e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:56.042158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b9fc043e-30ba-4595-ba81-52f07c0f458e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:56.042897 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b9fc043e-30ba-4595-ba81-52f07c0f458e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:56.043684 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b9fc043e-30ba-4595-ba81-52f07c0f458e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:56.044151 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b9fc043e-30ba-4595-ba81-52f07c0f458e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:56.204628 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b9fc043e-30ba-4595-ba81-52f07c0f458e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:56.216475 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b9fc043e-30ba-4595-ba81-52f07c0f458e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.187094 Apr 12 14:55:56.216565 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 127/246] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:56 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:57.239588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d13816f8-3ff2-4293-84c0-7e7f2c2480ca tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:57.239588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d13816f8-3ff2-4293-84c0-7e7f2c2480ca tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:57.248163 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d13816f8-3ff2-4293-84c0-7e7f2c2480ca tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:57.248703 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d13816f8-3ff2-4293-84c0-7e7f2c2480ca tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:57.249599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d13816f8-3ff2-4293-84c0-7e7f2c2480ca tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:57.250260 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d13816f8-3ff2-4293-84c0-7e7f2c2480ca tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:57.418182 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d13816f8-3ff2-4293-84c0-7e7f2c2480ca tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:57.425744 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d13816f8-3ff2-4293-84c0-7e7f2c2480ca tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.192996 Apr 12 14:55:57.426281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 120/247] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:57 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:58.443898 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-baddcff2-c019-42fe-9345-d502a431478b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:58.444687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-baddcff2-c019-42fe-9345-d502a431478b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:58.451935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-baddcff2-c019-42fe-9345-d502a431478b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:58.452462 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-baddcff2-c019-42fe-9345-d502a431478b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:58.453232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-baddcff2-c019-42fe-9345-d502a431478b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:58.453678 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-baddcff2-c019-42fe-9345-d502a431478b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:58.678633 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-baddcff2-c019-42fe-9345-d502a431478b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:58.689245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-baddcff2-c019-42fe-9345-d502a431478b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.247465 Apr 12 14:55:58.689245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 128/248] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:58 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:55:59.425580 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3f264b55-0446-4bf1-89e5-820b0ffddcf1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:59.426717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3f264b55-0446-4bf1-89e5-820b0ffddcf1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:59.439807 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f264b55-0446-4bf1-89e5-820b0ffddcf1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:59.440261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f264b55-0446-4bf1-89e5-820b0ffddcf1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:59.441211 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f264b55-0446-4bf1-89e5-820b0ffddcf1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:59.441686 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f264b55-0446-4bf1-89e5-820b0ffddcf1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:59.470853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3f264b55-0446-4bf1-89e5-820b0ffddcf1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/ips" status: 200 len: 147 microversion: 2.1 time: 0.051488 Apr 12 14:55:59.471457 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 121/249] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Apr 12 14:55:59 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/ips => generated 147 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:55:59.717081 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5359cb16-e006-4ad7-98bd-7f6181a7699e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:55:59.717680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5359cb16-e006-4ad7-98bd-7f6181a7699e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:55:59.724154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5359cb16-e006-4ad7-98bd-7f6181a7699e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:59.724612 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5359cb16-e006-4ad7-98bd-7f6181a7699e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:59.725417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5359cb16-e006-4ad7-98bd-7f6181a7699e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:55:59.725865 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5359cb16-e006-4ad7-98bd-7f6181a7699e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:55:59.886423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5359cb16-e006-4ad7-98bd-7f6181a7699e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:55:59.894316 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5359cb16-e006-4ad7-98bd-7f6181a7699e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.181077 Apr 12 14:55:59.899444 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 129/250] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:55:59 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:00.911900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bf77658c-d987-4c8a-bf39-f3c74038345f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:00.918104 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bf77658c-d987-4c8a-bf39-f3c74038345f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:00.919842 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf77658c-d987-4c8a-bf39-f3c74038345f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:00.920300 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf77658c-d987-4c8a-bf39-f3c74038345f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:00.921043 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf77658c-d987-4c8a-bf39-f3c74038345f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:00.921464 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf77658c-d987-4c8a-bf39-f3c74038345f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:01.052107 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bf77658c-d987-4c8a-bf39-f3c74038345f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:01.060017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bf77658c-d987-4c8a-bf39-f3c74038345f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.151875 Apr 12 14:56:01.060774 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 122/251] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:00 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:02.077623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5d29677c-0acf-454e-9cb4-8dca827879cd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:02.078259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5d29677c-0acf-454e-9cb4-8dca827879cd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:02.084764 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5d29677c-0acf-454e-9cb4-8dca827879cd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:02.085209 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5d29677c-0acf-454e-9cb4-8dca827879cd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:02.086712 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5d29677c-0acf-454e-9cb4-8dca827879cd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:02.087195 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5d29677c-0acf-454e-9cb4-8dca827879cd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:02.240783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5d29677c-0acf-454e-9cb4-8dca827879cd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:02.249546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5d29677c-0acf-454e-9cb4-8dca827879cd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.175665 Apr 12 14:56:02.254456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 130/252] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:02 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:03.270593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2f3c509b-0238-427c-b1f6-03b3bbb35591 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:03.271388 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2f3c509b-0238-427c-b1f6-03b3bbb35591 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:03.279169 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2f3c509b-0238-427c-b1f6-03b3bbb35591 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:03.279612 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2f3c509b-0238-427c-b1f6-03b3bbb35591 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:03.280388 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2f3c509b-0238-427c-b1f6-03b3bbb35591 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:03.280811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2f3c509b-0238-427c-b1f6-03b3bbb35591 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:03.410276 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-78c0e255-8b1d-4bbe-9295-e14255e33463 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dc08b93-3847-409c-94bb-f0b7178a30a6"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:03.411451 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-78c0e255-8b1d-4bbe-9295-e14255e33463 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:03.419143 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-78c0e255-8b1d-4bbe-9295-e14255e33463 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:03.419778 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-78c0e255-8b1d-4bbe-9295-e14255e33463 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:03.420571 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-78c0e255-8b1d-4bbe-9295-e14255e33463 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:03.420996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-78c0e255-8b1d-4bbe-9295-e14255e33463 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:03.434122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2f3c509b-0238-427c-b1f6-03b3bbb35591 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:03.445666 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2f3c509b-0238-427c-b1f6-03b3bbb35591 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.178614 Apr 12 14:56:03.447044 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 123/253] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:03 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:04.464038 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-331e1430-8f1b-4501-b91b-1a226985e753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:04.464689 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-331e1430-8f1b-4501-b91b-1a226985e753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:04.471654 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-331e1430-8f1b-4501-b91b-1a226985e753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:04.473314 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-331e1430-8f1b-4501-b91b-1a226985e753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:04.474347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-331e1430-8f1b-4501-b91b-1a226985e753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:04.474952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-331e1430-8f1b-4501-b91b-1a226985e753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:04.509557 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-78c0e255-8b1d-4bbe-9295-e14255e33463 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.104069 Apr 12 14:56:04.517117 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 131/254] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 14:56:03 2022] POST /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/os-volume_attachments => generated 194 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:56:04.645446 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-331e1430-8f1b-4501-b91b-1a226985e753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:04.660758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-331e1430-8f1b-4501-b91b-1a226985e753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1523 microversion: 2.1 time: 0.200917 Apr 12 14:56:04.661346 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 124/255] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:04 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:05.682453 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-618d820b-c970-4944-a8ba-5c132d839e13 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:05.685004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-618d820b-c970-4944-a8ba-5c132d839e13 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:05.691668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-618d820b-c970-4944-a8ba-5c132d839e13 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:05.692101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-618d820b-c970-4944-a8ba-5c132d839e13 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:05.693796 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-618d820b-c970-4944-a8ba-5c132d839e13 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:05.693796 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-618d820b-c970-4944-a8ba-5c132d839e13 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:05.856238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-618d820b-c970-4944-a8ba-5c132d839e13 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:05.864308 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-618d820b-c970-4944-a8ba-5c132d839e13 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1503 microversion: 2.1 time: 0.187588 Apr 12 14:56:05.864973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 132/256] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:05 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:05.881763 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-323dfeec-21ff-42fc-a3f6-8d39a705f581 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:05.882422 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-323dfeec-21ff-42fc-a3f6-8d39a705f581 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:05.906108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-323dfeec-21ff-42fc-a3f6-8d39a705f581 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:05.906108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-323dfeec-21ff-42fc-a3f6-8d39a705f581 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:05.906604 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-323dfeec-21ff-42fc-a3f6-8d39a705f581 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:05.907210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-323dfeec-21ff-42fc-a3f6-8d39a705f581 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:06.058796 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-323dfeec-21ff-42fc-a3f6-8d39a705f581 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:06.072927 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-323dfeec-21ff-42fc-a3f6-8d39a705f581 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1515 microversion: 2.1 time: 0.195085 Apr 12 14:56:06.074348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 125/257] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:05 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:10.106202 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e331c078-b248-425e-b734-2615f99bd1b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:10.106834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e331c078-b248-425e-b734-2615f99bd1b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:10.118219 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e331c078-b248-425e-b734-2615f99bd1b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:10.119605 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e331c078-b248-425e-b734-2615f99bd1b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:10.121168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e331c078-b248-425e-b734-2615f99bd1b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:10.121919 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e331c078-b248-425e-b734-2615f99bd1b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:10.158154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e331c078-b248-425e-b734-2615f99bd1b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/ips" status: 200 len: 151 microversion: 2.20 time: 0.056745 Apr 12 14:56:10.158952 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 133/258] 10.222.0.64 () {60 vars in 1288 bytes} [Tue Apr 12 14:56:10 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/ips => generated 151 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:56:10.196574 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-260ebaa6-959a-4833-a45d-86f88fbb6ac7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:10.198174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-260ebaa6-959a-4833-a45d-86f88fbb6ac7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:10.205142 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-260ebaa6-959a-4833-a45d-86f88fbb6ac7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:10.205589 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-260ebaa6-959a-4833-a45d-86f88fbb6ac7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:10.206412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-260ebaa6-959a-4833-a45d-86f88fbb6ac7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:10.207175 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-260ebaa6-959a-4833-a45d-86f88fbb6ac7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:10.232311 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-260ebaa6-959a-4833-a45d-86f88fbb6ac7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lazy-loading 'flavor' on Instance uuid 92e6b586-ce02-4394-a2a1-6ae5e0f09306 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:56:10.576272 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-260ebaa6-959a-4833-a45d-86f88fbb6ac7 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306/action" status: 200 len: 32 microversion: 2.1 time: 0.384417 Apr 12 14:56:10.576791 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 126/259] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 14:56:10 2022] POST /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 14:56:10.586086 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-35b5393f-d060-420c-8dcd-741ff62c562e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:10.586689 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-35b5393f-d060-420c-8dcd-741ff62c562e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:10.593703 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35b5393f-d060-420c-8dcd-741ff62c562e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:10.594230 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35b5393f-d060-420c-8dcd-741ff62c562e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:10.595103 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35b5393f-d060-420c-8dcd-741ff62c562e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:10.595620 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35b5393f-d060-420c-8dcd-741ff62c562e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:10.742108 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-35b5393f-d060-420c-8dcd-741ff62c562e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:10.749542 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-35b5393f-d060-420c-8dcd-741ff62c562e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.167304 Apr 12 14:56:10.750465 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 134/260] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:10 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:11.767902 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-65208ce4-7996-4e49-9c13-38bb3e453448 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:11.768589 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-65208ce4-7996-4e49-9c13-38bb3e453448 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:11.774919 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-65208ce4-7996-4e49-9c13-38bb3e453448 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:11.775719 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-65208ce4-7996-4e49-9c13-38bb3e453448 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:11.776130 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-65208ce4-7996-4e49-9c13-38bb3e453448 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:11.776685 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-65208ce4-7996-4e49-9c13-38bb3e453448 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:11.916794 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-65208ce4-7996-4e49-9c13-38bb3e453448 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:11.924419 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-65208ce4-7996-4e49-9c13-38bb3e453448 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.160904 Apr 12 14:56:11.924995 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 127/261] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:11 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:12.942607 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dcd0755f-b1d6-4b0b-b846-288c81f5cf53 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:12.944001 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dcd0755f-b1d6-4b0b-b846-288c81f5cf53 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:12.951964 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dcd0755f-b1d6-4b0b-b846-288c81f5cf53 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:12.955144 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dcd0755f-b1d6-4b0b-b846-288c81f5cf53 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:12.955144 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dcd0755f-b1d6-4b0b-b846-288c81f5cf53 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:12.955144 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dcd0755f-b1d6-4b0b-b846-288c81f5cf53 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:13.125645 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dcd0755f-b1d6-4b0b-b846-288c81f5cf53 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:13.133049 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dcd0755f-b1d6-4b0b-b846-288c81f5cf53 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.194637 Apr 12 14:56:13.133617 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 135/262] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:12 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:14.156534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ba3c6f92-1e14-4483-950a-43a4f26d5483 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:14.157075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ba3c6f92-1e14-4483-950a-43a4f26d5483 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:14.166103 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ba3c6f92-1e14-4483-950a-43a4f26d5483 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:14.167109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ba3c6f92-1e14-4483-950a-43a4f26d5483 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:14.167916 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ba3c6f92-1e14-4483-950a-43a4f26d5483 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:14.168510 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ba3c6f92-1e14-4483-950a-43a4f26d5483 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:14.326759 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ba3c6f92-1e14-4483-950a-43a4f26d5483 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:14.335561 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ba3c6f92-1e14-4483-950a-43a4f26d5483 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.188941 Apr 12 14:56:14.336135 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 128/263] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:14 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:14.923088 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-57777c37-820c-44bc-b91e-df1af6bd5962 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:14.923696 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-57777c37-820c-44bc-b91e-df1af6bd5962 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:14.930455 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57777c37-820c-44bc-b91e-df1af6bd5962 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:14.930944 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57777c37-820c-44bc-b91e-df1af6bd5962 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:14.932229 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57777c37-820c-44bc-b91e-df1af6bd5962 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:14.932695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57777c37-820c-44bc-b91e-df1af6bd5962 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:14.972850 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-57777c37-820c-44bc-b91e-df1af6bd5962 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lazy-loading 'flavor' on Instance uuid 9d03f42e-2d51-459d-ade0-7e6a34283867 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:56:15.356393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-12bf8861-ba9c-4603-9ab9-5117e6ba4043 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:15.357747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-12bf8861-ba9c-4603-9ab9-5117e6ba4043 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:15.365998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-12bf8861-ba9c-4603-9ab9-5117e6ba4043 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:15.366751 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-12bf8861-ba9c-4603-9ab9-5117e6ba4043 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:15.367197 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-12bf8861-ba9c-4603-9ab9-5117e6ba4043 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:15.367636 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-12bf8861-ba9c-4603-9ab9-5117e6ba4043 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:15.506658 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-12bf8861-ba9c-4603-9ab9-5117e6ba4043 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:15.519652 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-12bf8861-ba9c-4603-9ab9-5117e6ba4043 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.168715 Apr 12 14:56:15.520328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 129/264] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:15 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:15.550831 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-57777c37-820c-44bc-b91e-df1af6bd5962 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "POST /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/action" status: 202 len: 0 microversion: 2.20 time: 0.631399 Apr 12 14:56:15.555479 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 136/265] 10.222.0.64 () {62 vars in 1318 bytes} [Tue Apr 12 14:56:14 2022] POST /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 14:56:15.561256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-21344f14-dc17-4a49-b459-035e75ed394a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:15.562287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-21344f14-dc17-4a49-b459-035e75ed394a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:15.568911 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21344f14-dc17-4a49-b459-035e75ed394a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:15.569350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21344f14-dc17-4a49-b459-035e75ed394a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:15.570180 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21344f14-dc17-4a49-b459-035e75ed394a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:15.570611 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21344f14-dc17-4a49-b459-035e75ed394a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:15.744798 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-21344f14-dc17-4a49-b459-035e75ed394a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:15.760846 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-21344f14-dc17-4a49-b459-035e75ed394a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:15.768216 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-21344f14-dc17-4a49-b459-035e75ed394a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:15.770799 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-21344f14-dc17-4a49-b459-035e75ed394a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.213206 Apr 12 14:56:15.771640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 130/266] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:15 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:16.540654 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5129113b-da95-4764-9cd3-b2635b6d72f3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:16.541325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5129113b-da95-4764-9cd3-b2635b6d72f3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:16.548014 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5129113b-da95-4764-9cd3-b2635b6d72f3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:16.548457 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5129113b-da95-4764-9cd3-b2635b6d72f3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:16.549224 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5129113b-da95-4764-9cd3-b2635b6d72f3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:16.549662 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5129113b-da95-4764-9cd3-b2635b6d72f3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:16.685763 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5129113b-da95-4764-9cd3-b2635b6d72f3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:16.698626 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5129113b-da95-4764-9cd3-b2635b6d72f3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.157827 Apr 12 14:56:16.698626 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 137/267] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:16 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:16.758079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c3613bab-156e-4e84-a951-2fc46860f200 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:16.766758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c3613bab-156e-4e84-a951-2fc46860f200 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:16.767378 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c3613bab-156e-4e84-a951-2fc46860f200 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:16.797342 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-93d67b94-e457-41bc-9f62-a3167101362e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:16.803476 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-93d67b94-e457-41bc-9f62-a3167101362e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:16.808537 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-93d67b94-e457-41bc-9f62-a3167101362e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:16.809041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-93d67b94-e457-41bc-9f62-a3167101362e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:16.809868 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-93d67b94-e457-41bc-9f62-a3167101362e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:16.810298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-93d67b94-e457-41bc-9f62-a3167101362e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:16.869669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c3613bab-156e-4e84-a951-2fc46860f200 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Going to try to stop instance {{(pid=124199) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 12 14:56:16.978761 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-93d67b94-e457-41bc-9f62-a3167101362e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:16.987378 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-93d67b94-e457-41bc-9f62-a3167101362e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:16.988959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-93d67b94-e457-41bc-9f62-a3167101362e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:16.990148 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-93d67b94-e457-41bc-9f62-a3167101362e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.196877 Apr 12 14:56:16.990697 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 138/268] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:16 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:17.088625 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c3613bab-156e-4e84-a951-2fc46860f200 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/action" status: 202 len: 0 microversion: 2.1 time: 0.333537 Apr 12 14:56:17.089225 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 131/269] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 14:56:16 2022] POST /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:56:17.101311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c47f3e7a-db1f-4d56-9f8f-4d273742b8df tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:17.101950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c47f3e7a-db1f-4d56-9f8f-4d273742b8df tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:17.108638 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c47f3e7a-db1f-4d56-9f8f-4d273742b8df tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:17.109093 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c47f3e7a-db1f-4d56-9f8f-4d273742b8df tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:17.109897 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c47f3e7a-db1f-4d56-9f8f-4d273742b8df tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:17.110373 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c47f3e7a-db1f-4d56-9f8f-4d273742b8df tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:17.212731 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1017371c-c834-4a5e-8829-7ef9e8c87422 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:17.213316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1017371c-c834-4a5e-8829-7ef9e8c87422 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:17.221421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1017371c-c834-4a5e-8829-7ef9e8c87422 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:17.222142 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1017371c-c834-4a5e-8829-7ef9e8c87422 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:17.222935 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1017371c-c834-4a5e-8829-7ef9e8c87422 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:17.223372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1017371c-c834-4a5e-8829-7ef9e8c87422 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:17.249085 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1017371c-c834-4a5e-8829-7ef9e8c87422 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/ips" status: 200 len: 147 microversion: 2.1 time: 0.049427 Apr 12 14:56:17.249902 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 132/270] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Apr 12 14:56:17 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/ips => generated 147 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:56:17.255558 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c47f3e7a-db1f-4d56-9f8f-4d273742b8df tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:17.272858 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c47f3e7a-db1f-4d56-9f8f-4d273742b8df tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.175763 Apr 12 14:56:17.273370 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 139/271] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:17 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:17.716627 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fa4fba4d-b6d8-4a32-ab88-3cb09b43205b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:17.717230 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fa4fba4d-b6d8-4a32-ab88-3cb09b43205b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:17.723307 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fa4fba4d-b6d8-4a32-ab88-3cb09b43205b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:17.723749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fa4fba4d-b6d8-4a32-ab88-3cb09b43205b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:17.729024 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fa4fba4d-b6d8-4a32-ab88-3cb09b43205b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:17.729024 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fa4fba4d-b6d8-4a32-ab88-3cb09b43205b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:17.871221 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fa4fba4d-b6d8-4a32-ab88-3cb09b43205b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:17.883566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fa4fba4d-b6d8-4a32-ab88-3cb09b43205b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.171173 Apr 12 14:56:17.893730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 133/272] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:17 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:18.019865 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d12c0ee0-b5a0-490c-bee8-60b60c5a8445 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:18.020902 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d12c0ee0-b5a0-490c-bee8-60b60c5a8445 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:18.030168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d12c0ee0-b5a0-490c-bee8-60b60c5a8445 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:18.033844 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d12c0ee0-b5a0-490c-bee8-60b60c5a8445 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:18.036034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d12c0ee0-b5a0-490c-bee8-60b60c5a8445 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:18.036034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d12c0ee0-b5a0-490c-bee8-60b60c5a8445 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:18.235569 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d12c0ee0-b5a0-490c-bee8-60b60c5a8445 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:18.244282 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d12c0ee0-b5a0-490c-bee8-60b60c5a8445 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:18.246584 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d12c0ee0-b5a0-490c-bee8-60b60c5a8445 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:18.247857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d12c0ee0-b5a0-490c-bee8-60b60c5a8445 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.241993 Apr 12 14:56:18.248421 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 140/273] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:18 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:18.292381 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fbefdc60-ea69-4cb3-850d-08d1b35888d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:18.292982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fbefdc60-ea69-4cb3-850d-08d1b35888d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:18.299420 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fbefdc60-ea69-4cb3-850d-08d1b35888d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:18.299879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fbefdc60-ea69-4cb3-850d-08d1b35888d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:18.300651 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fbefdc60-ea69-4cb3-850d-08d1b35888d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:18.301098 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fbefdc60-ea69-4cb3-850d-08d1b35888d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:18.506103 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fbefdc60-ea69-4cb3-850d-08d1b35888d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:18.514844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fbefdc60-ea69-4cb3-850d-08d1b35888d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.227121 Apr 12 14:56:18.515516 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 134/274] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:18 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:18.902268 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3842adf8-bd6e-4c4b-9201-650ab83ca58a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:18.902948 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3842adf8-bd6e-4c4b-9201-650ab83ca58a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:18.909597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3842adf8-bd6e-4c4b-9201-650ab83ca58a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:18.911200 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3842adf8-bd6e-4c4b-9201-650ab83ca58a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:18.911200 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3842adf8-bd6e-4c4b-9201-650ab83ca58a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:18.911409 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3842adf8-bd6e-4c4b-9201-650ab83ca58a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:19.067717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3842adf8-bd6e-4c4b-9201-650ab83ca58a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:19.076818 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3842adf8-bd6e-4c4b-9201-650ab83ca58a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.179119 Apr 12 14:56:19.077390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 141/275] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:18 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:19.160318 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5d42330a-f2c6-45ce-889a-b9ebc5a442b2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f36cad5f-69c6-422b-80a6-5eb57db57451"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:19.161445 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5d42330a-f2c6-45ce-889a-b9ebc5a442b2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:19.169052 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5d42330a-f2c6-45ce-889a-b9ebc5a442b2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:19.169052 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5d42330a-f2c6-45ce-889a-b9ebc5a442b2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:19.169562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5d42330a-f2c6-45ce-889a-b9ebc5a442b2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:19.170097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5d42330a-f2c6-45ce-889a-b9ebc5a442b2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:19.266064 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b9a9e079-465b-491f-9b2b-5d03a9cd9061 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:19.266673 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b9a9e079-465b-491f-9b2b-5d03a9cd9061 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:19.272761 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b9a9e079-465b-491f-9b2b-5d03a9cd9061 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:19.278716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b9a9e079-465b-491f-9b2b-5d03a9cd9061 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:19.278716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b9a9e079-465b-491f-9b2b-5d03a9cd9061 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:19.278716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b9a9e079-465b-491f-9b2b-5d03a9cd9061 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:19.408911 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b9a9e079-465b-491f-9b2b-5d03a9cd9061 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:19.417666 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b9a9e079-465b-491f-9b2b-5d03a9cd9061 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:19.419244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b9a9e079-465b-491f-9b2b-5d03a9cd9061 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:19.420298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b9a9e079-465b-491f-9b2b-5d03a9cd9061 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.158275 Apr 12 14:56:19.420907 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 142/276] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:19 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:56:19.537330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-86ef8c5a-4c74-4eb9-8ca6-2bc253318ef7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:19.538170 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-86ef8c5a-4c74-4eb9-8ca6-2bc253318ef7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:19.544703 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-86ef8c5a-4c74-4eb9-8ca6-2bc253318ef7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:19.545157 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-86ef8c5a-4c74-4eb9-8ca6-2bc253318ef7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:19.546127 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-86ef8c5a-4c74-4eb9-8ca6-2bc253318ef7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:19.546559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-86ef8c5a-4c74-4eb9-8ca6-2bc253318ef7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:19.689886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-86ef8c5a-4c74-4eb9-8ca6-2bc253318ef7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:19.699095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-86ef8c5a-4c74-4eb9-8ca6-2bc253318ef7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.166066 Apr 12 14:56:19.699680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 143/277] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:19 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:20.048649 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5d42330a-f2c6-45ce-889a-b9ebc5a442b2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.892165 Apr 12 14:56:20.049375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 135/278] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 14:56:19 2022] POST /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-volume_attachments => generated 194 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:56:20.093947 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-126c17d0-c2b6-48d4-9efa-23528cadb7e2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:20.095142 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-126c17d0-c2b6-48d4-9efa-23528cadb7e2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:20.102129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-126c17d0-c2b6-48d4-9efa-23528cadb7e2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:20.103108 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-126c17d0-c2b6-48d4-9efa-23528cadb7e2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:20.103889 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-126c17d0-c2b6-48d4-9efa-23528cadb7e2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:20.104606 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-126c17d0-c2b6-48d4-9efa-23528cadb7e2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:20.253949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-126c17d0-c2b6-48d4-9efa-23528cadb7e2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:20.262281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-126c17d0-c2b6-48d4-9efa-23528cadb7e2 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.172386 Apr 12 14:56:20.262860 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 144/279] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:20 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:20.440679 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ab58aed5-c36b-4ada-afc2-188f434b9400 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:20.441449 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ab58aed5-c36b-4ada-afc2-188f434b9400 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:20.447890 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab58aed5-c36b-4ada-afc2-188f434b9400 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:20.448346 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab58aed5-c36b-4ada-afc2-188f434b9400 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:20.449333 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab58aed5-c36b-4ada-afc2-188f434b9400 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:20.449947 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab58aed5-c36b-4ada-afc2-188f434b9400 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:20.599435 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ab58aed5-c36b-4ada-afc2-188f434b9400 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:20.607984 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ab58aed5-c36b-4ada-afc2-188f434b9400 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:20.609491 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ab58aed5-c36b-4ada-afc2-188f434b9400 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:20.610681 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ab58aed5-c36b-4ada-afc2-188f434b9400 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.174822 Apr 12 14:56:20.611238 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 136/280] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:20 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:20.717171 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8bbe8ef5-468d-4c65-9a7e-c7873d753a77 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:20.717841 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8bbe8ef5-468d-4c65-9a7e-c7873d753a77 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:20.724047 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bbe8ef5-468d-4c65-9a7e-c7873d753a77 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:20.724529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bbe8ef5-468d-4c65-9a7e-c7873d753a77 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:20.725309 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bbe8ef5-468d-4c65-9a7e-c7873d753a77 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:20.725763 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bbe8ef5-468d-4c65-9a7e-c7873d753a77 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:20.857231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8bbe8ef5-468d-4c65-9a7e-c7873d753a77 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:20.865872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8bbe8ef5-468d-4c65-9a7e-c7873d753a77 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.152308 Apr 12 14:56:20.866502 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 145/281] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:20 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:21.279099 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-60b5886f-2b23-4556-b678-e24c05d4960e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:21.279707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-60b5886f-2b23-4556-b678-e24c05d4960e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:21.286124 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60b5886f-2b23-4556-b678-e24c05d4960e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:21.286572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60b5886f-2b23-4556-b678-e24c05d4960e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:21.287350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60b5886f-2b23-4556-b678-e24c05d4960e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:21.287780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60b5886f-2b23-4556-b678-e24c05d4960e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:21.424916 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-60b5886f-2b23-4556-b678-e24c05d4960e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:21.433371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-60b5886f-2b23-4556-b678-e24c05d4960e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.158123 Apr 12 14:56:21.433982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 137/282] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:21 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:21.628799 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-49ff3ee6-fe29-4fed-bcc7-d39594a9169b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:21.629366 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-49ff3ee6-fe29-4fed-bcc7-d39594a9169b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:21.636093 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-49ff3ee6-fe29-4fed-bcc7-d39594a9169b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:21.636533 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-49ff3ee6-fe29-4fed-bcc7-d39594a9169b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:21.637345 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-49ff3ee6-fe29-4fed-bcc7-d39594a9169b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:21.637807 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-49ff3ee6-fe29-4fed-bcc7-d39594a9169b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:21.773914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-49ff3ee6-fe29-4fed-bcc7-d39594a9169b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:21.782475 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-49ff3ee6-fe29-4fed-bcc7-d39594a9169b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:21.783981 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-49ff3ee6-fe29-4fed-bcc7-d39594a9169b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:21.785138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-49ff3ee6-fe29-4fed-bcc7-d39594a9169b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.160389 Apr 12 14:56:21.785728 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 146/283] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:21 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:21.883346 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-738bf892-4847-4e78-87bb-6cffe016fb82 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:21.883978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-738bf892-4847-4e78-87bb-6cffe016fb82 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:21.890978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-738bf892-4847-4e78-87bb-6cffe016fb82 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:21.891417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-738bf892-4847-4e78-87bb-6cffe016fb82 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:21.892181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-738bf892-4847-4e78-87bb-6cffe016fb82 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:21.892615 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-738bf892-4847-4e78-87bb-6cffe016fb82 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:22.073183 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-738bf892-4847-4e78-87bb-6cffe016fb82 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:22.088079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-738bf892-4847-4e78-87bb-6cffe016fb82 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.207385 Apr 12 14:56:22.088821 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 138/284] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:21 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:22.451531 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c4bad47a-6c50-48f9-8a5f-90705a318aeb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:22.452276 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c4bad47a-6c50-48f9-8a5f-90705a318aeb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:22.458730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c4bad47a-6c50-48f9-8a5f-90705a318aeb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:22.459135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c4bad47a-6c50-48f9-8a5f-90705a318aeb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:22.459853 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c4bad47a-6c50-48f9-8a5f-90705a318aeb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:22.460289 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c4bad47a-6c50-48f9-8a5f-90705a318aeb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:22.598114 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c4bad47a-6c50-48f9-8a5f-90705a318aeb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:22.605978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c4bad47a-6c50-48f9-8a5f-90705a318aeb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.158538 Apr 12 14:56:22.606560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 147/285] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:22 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:22.807978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1422812a-2510-4dcb-a022-f7bd8c8b1aba tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:22.808870 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1422812a-2510-4dcb-a022-f7bd8c8b1aba tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:22.815309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1422812a-2510-4dcb-a022-f7bd8c8b1aba tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:22.815766 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1422812a-2510-4dcb-a022-f7bd8c8b1aba tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:22.816551 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1422812a-2510-4dcb-a022-f7bd8c8b1aba tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:22.816992 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1422812a-2510-4dcb-a022-f7bd8c8b1aba tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:22.967565 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1422812a-2510-4dcb-a022-f7bd8c8b1aba tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:22.979415 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1422812a-2510-4dcb-a022-f7bd8c8b1aba tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:22.979415 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1422812a-2510-4dcb-a022-f7bd8c8b1aba tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:22.979784 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1422812a-2510-4dcb-a022-f7bd8c8b1aba tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.176797 Apr 12 14:56:22.980354 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 139/286] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:22 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:56:23.107798 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bcee732d-f345-45d2-b33b-858539231449 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:23.108823 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bcee732d-f345-45d2-b33b-858539231449 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:23.116574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bcee732d-f345-45d2-b33b-858539231449 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:23.117014 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bcee732d-f345-45d2-b33b-858539231449 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:23.117829 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bcee732d-f345-45d2-b33b-858539231449 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:23.118973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bcee732d-f345-45d2-b33b-858539231449 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:23.265972 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bcee732d-f345-45d2-b33b-858539231449 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:23.275551 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bcee732d-f345-45d2-b33b-858539231449 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.172389 Apr 12 14:56:23.278841 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 148/287] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:23 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:23.622924 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fbad925c-af40-4271-acf1-72f0fe809b82 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:23.623441 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fbad925c-af40-4271-acf1-72f0fe809b82 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:23.629309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fbad925c-af40-4271-acf1-72f0fe809b82 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:23.629793 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fbad925c-af40-4271-acf1-72f0fe809b82 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:23.630692 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fbad925c-af40-4271-acf1-72f0fe809b82 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:23.631012 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fbad925c-af40-4271-acf1-72f0fe809b82 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:23.765226 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fbad925c-af40-4271-acf1-72f0fe809b82 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:23.773065 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fbad925c-af40-4271-acf1-72f0fe809b82 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.153991 Apr 12 14:56:23.773680 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 140/288] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:23 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:23.999150 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8abd36f1-0ee1-4377-b77e-d4bf5c290cbd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:23.999773 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8abd36f1-0ee1-4377-b77e-d4bf5c290cbd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:24.005874 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8abd36f1-0ee1-4377-b77e-d4bf5c290cbd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:24.006309 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8abd36f1-0ee1-4377-b77e-d4bf5c290cbd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:24.007073 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8abd36f1-0ee1-4377-b77e-d4bf5c290cbd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:24.007498 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8abd36f1-0ee1-4377-b77e-d4bf5c290cbd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:24.164747 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8abd36f1-0ee1-4377-b77e-d4bf5c290cbd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:24.174420 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8abd36f1-0ee1-4377-b77e-d4bf5c290cbd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:24.176321 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8abd36f1-0ee1-4377-b77e-d4bf5c290cbd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:24.177747 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8abd36f1-0ee1-4377-b77e-d4bf5c290cbd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.182668 Apr 12 14:56:24.190661 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 149/289] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:23 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:24.295740 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3f415064-0d8c-4e81-b2f5-8c74b522a8a6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:24.296354 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3f415064-0d8c-4e81-b2f5-8c74b522a8a6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:24.302838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f415064-0d8c-4e81-b2f5-8c74b522a8a6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:24.303380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f415064-0d8c-4e81-b2f5-8c74b522a8a6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:24.304123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f415064-0d8c-4e81-b2f5-8c74b522a8a6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:24.304545 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f415064-0d8c-4e81-b2f5-8c74b522a8a6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:24.456052 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3f415064-0d8c-4e81-b2f5-8c74b522a8a6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:24.468342 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3f415064-0d8c-4e81-b2f5-8c74b522a8a6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.176362 Apr 12 14:56:24.469040 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 141/290] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:24 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:24.792414 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-565f9db0-56ca-45f8-8850-4c0ce53f866c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:24.793023 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-565f9db0-56ca-45f8-8850-4c0ce53f866c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:24.799436 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-565f9db0-56ca-45f8-8850-4c0ce53f866c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:24.799875 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-565f9db0-56ca-45f8-8850-4c0ce53f866c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:24.800634 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-565f9db0-56ca-45f8-8850-4c0ce53f866c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:24.801064 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-565f9db0-56ca-45f8-8850-4c0ce53f866c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:24.932325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-565f9db0-56ca-45f8-8850-4c0ce53f866c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:24.940649 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-565f9db0-56ca-45f8-8850-4c0ce53f866c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.152635 Apr 12 14:56:24.941211 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 150/291] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:24 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:25.199530 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9fa2d7ac-fe6e-4b0d-967d-9798f50d2916 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:25.199530 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9fa2d7ac-fe6e-4b0d-967d-9798f50d2916 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:25.215687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fa2d7ac-fe6e-4b0d-967d-9798f50d2916 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:25.216146 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fa2d7ac-fe6e-4b0d-967d-9798f50d2916 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:25.216923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fa2d7ac-fe6e-4b0d-967d-9798f50d2916 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:25.217350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fa2d7ac-fe6e-4b0d-967d-9798f50d2916 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:25.360250 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fa2d7ac-fe6e-4b0d-967d-9798f50d2916 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:25.370247 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fa2d7ac-fe6e-4b0d-967d-9798f50d2916 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:25.370247 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fa2d7ac-fe6e-4b0d-967d-9798f50d2916 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:25.370907 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9fa2d7ac-fe6e-4b0d-967d-9798f50d2916 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.177169 Apr 12 14:56:25.371464 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 142/292] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:25 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:25.495732 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-06ae1591-cfd6-41dd-aa21-4ea3191fcfbe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:25.496469 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-06ae1591-cfd6-41dd-aa21-4ea3191fcfbe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:25.502660 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ae1591-cfd6-41dd-aa21-4ea3191fcfbe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:25.503105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ae1591-cfd6-41dd-aa21-4ea3191fcfbe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:25.503871 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ae1591-cfd6-41dd-aa21-4ea3191fcfbe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:25.504298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ae1591-cfd6-41dd-aa21-4ea3191fcfbe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:25.646722 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-06ae1591-cfd6-41dd-aa21-4ea3191fcfbe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:25.656245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-06ae1591-cfd6-41dd-aa21-4ea3191fcfbe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.167809 Apr 12 14:56:25.656814 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 151/293] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:25 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:25.958416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2a029e92-444d-4619-924b-2c0647a47479 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:25.959017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2a029e92-444d-4619-924b-2c0647a47479 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:25.964977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a029e92-444d-4619-924b-2c0647a47479 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:25.980322 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a029e92-444d-4619-924b-2c0647a47479 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:25.980322 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a029e92-444d-4619-924b-2c0647a47479 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:25.980322 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a029e92-444d-4619-924b-2c0647a47479 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:26.096766 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2a029e92-444d-4619-924b-2c0647a47479 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:26.104999 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2a029e92-444d-4619-924b-2c0647a47479 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.150385 Apr 12 14:56:26.106046 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 143/294] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:25 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:26.389133 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-049dbf8a-9b4d-4e43-b801-6d1aac857258 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:26.389681 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-049dbf8a-9b4d-4e43-b801-6d1aac857258 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:26.395653 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-049dbf8a-9b4d-4e43-b801-6d1aac857258 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:26.396105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-049dbf8a-9b4d-4e43-b801-6d1aac857258 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:26.397302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-049dbf8a-9b4d-4e43-b801-6d1aac857258 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:26.397821 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-049dbf8a-9b4d-4e43-b801-6d1aac857258 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:26.535456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-049dbf8a-9b4d-4e43-b801-6d1aac857258 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:26.544245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-049dbf8a-9b4d-4e43-b801-6d1aac857258 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:26.545712 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-049dbf8a-9b4d-4e43-b801-6d1aac857258 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:26.550210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-049dbf8a-9b4d-4e43-b801-6d1aac857258 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.161948 Apr 12 14:56:26.550210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 152/295] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:26 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:26.674429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-66fdcfcc-c374-44b7-addf-401da00982d8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:26.674984 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-66fdcfcc-c374-44b7-addf-401da00982d8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:26.681798 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66fdcfcc-c374-44b7-addf-401da00982d8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:26.682250 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66fdcfcc-c374-44b7-addf-401da00982d8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:26.683015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66fdcfcc-c374-44b7-addf-401da00982d8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:26.683450 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66fdcfcc-c374-44b7-addf-401da00982d8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:26.819209 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-66fdcfcc-c374-44b7-addf-401da00982d8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:26.830726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-66fdcfcc-c374-44b7-addf-401da00982d8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.158153 Apr 12 14:56:26.830726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 144/296] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:26 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:27.123385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-999f22d1-9b4d-43b8-a857-41176520353f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:27.123994 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-999f22d1-9b4d-43b8-a857-41176520353f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:27.130590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-999f22d1-9b4d-43b8-a857-41176520353f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:27.131041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-999f22d1-9b4d-43b8-a857-41176520353f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:27.131834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-999f22d1-9b4d-43b8-a857-41176520353f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:27.132260 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-999f22d1-9b4d-43b8-a857-41176520353f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:27.275052 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-999f22d1-9b4d-43b8-a857-41176520353f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:27.283359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-999f22d1-9b4d-43b8-a857-41176520353f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.163675 Apr 12 14:56:27.284556 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 153/297] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:27 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:27.565922 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7ed62adc-f0af-48be-88f7-77e4069e691f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:27.566602 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7ed62adc-f0af-48be-88f7-77e4069e691f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:27.573657 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ed62adc-f0af-48be-88f7-77e4069e691f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:27.574218 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ed62adc-f0af-48be-88f7-77e4069e691f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:27.577393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ed62adc-f0af-48be-88f7-77e4069e691f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:27.577393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ed62adc-f0af-48be-88f7-77e4069e691f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:27.598240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-23b5f386-38b7-4572-8079-788e6f0a8dac tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: .version_select at 0x7fbd60ad1af0>, body: {"keypair": {"name": "tempest-keypair-437604112"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:27.615717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-23b5f386-38b7-4572-8079-788e6f0a8dac tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:56:27.620284 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-23b5f386-38b7-4572-8079-788e6f0a8dac tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:56:27.739728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7ed62adc-f0af-48be-88f7-77e4069e691f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:27.748489 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7ed62adc-f0af-48be-88f7-77e4069e691f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:27.750027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7ed62adc-f0af-48be-88f7-77e4069e691f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:27.751176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7ed62adc-f0af-48be-88f7-77e4069e691f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.189645 Apr 12 14:56:27.752043 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 145/298] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:27 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:27.823760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-23b5f386-38b7-4572-8079-788e6f0a8dac tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:56:27.829259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-23b5f386-38b7-4572-8079-788e6f0a8dac tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:56:27.847115 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-23b5f386-38b7-4572-8079-788e6f0a8dac tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.252661 Apr 12 14:56:27.849125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 154/299] 10.222.0.64 () {60 vars in 1157 bytes} [Tue Apr 12 14:56:27 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:27.849241 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7f540708-7f42-4ea0-a173-1478c981b656 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:27.850234 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7f540708-7f42-4ea0-a173-1478c981b656 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:27.860609 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f540708-7f42-4ea0-a173-1478c981b656 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:27.861051 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f540708-7f42-4ea0-a173-1478c981b656 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:27.861948 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f540708-7f42-4ea0-a173-1478c981b656 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:27.862443 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f540708-7f42-4ea0-a173-1478c981b656 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:28.108126 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7f540708-7f42-4ea0-a173-1478c981b656 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:28.119604 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7f540708-7f42-4ea0-a173-1478c981b656 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.276714 Apr 12 14:56:28.120400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 146/300] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:27 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:28.302004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4faa4bf6-6c9e-4dc2-b4ec-e231cf97309f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:28.302616 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4faa4bf6-6c9e-4dc2-b4ec-e231cf97309f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:28.309423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4faa4bf6-6c9e-4dc2-b4ec-e231cf97309f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:28.309971 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4faa4bf6-6c9e-4dc2-b4ec-e231cf97309f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:28.310758 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4faa4bf6-6c9e-4dc2-b4ec-e231cf97309f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:28.311180 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4faa4bf6-6c9e-4dc2-b4ec-e231cf97309f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:28.507121 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4faa4bf6-6c9e-4dc2-b4ec-e231cf97309f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:28.515571 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4faa4bf6-6c9e-4dc2-b4ec-e231cf97309f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.217583 Apr 12 14:56:28.524164 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 155/301] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:28 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:28.771058 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5eb44c5f-e065-4c46-ad94-91ebd338a3ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:28.771649 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5eb44c5f-e065-4c46-ad94-91ebd338a3ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:28.778891 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5eb44c5f-e065-4c46-ad94-91ebd338a3ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:28.779416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5eb44c5f-e065-4c46-ad94-91ebd338a3ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:28.780202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5eb44c5f-e065-4c46-ad94-91ebd338a3ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:28.780625 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5eb44c5f-e065-4c46-ad94-91ebd338a3ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:28.932321 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5eb44c5f-e065-4c46-ad94-91ebd338a3ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:28.940888 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5eb44c5f-e065-4c46-ad94-91ebd338a3ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:28.942518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5eb44c5f-e065-4c46-ad94-91ebd338a3ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:28.943833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5eb44c5f-e065-4c46-ad94-91ebd338a3ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.176865 Apr 12 14:56:28.944522 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 147/302] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:28 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:29.139410 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-57f6b1a1-3b0a-4e4a-b7ac-790353bbd11a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:29.140922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-57f6b1a1-3b0a-4e4a-b7ac-790353bbd11a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:29.147711 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57f6b1a1-3b0a-4e4a-b7ac-790353bbd11a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:29.153949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57f6b1a1-3b0a-4e4a-b7ac-790353bbd11a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:29.153949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57f6b1a1-3b0a-4e4a-b7ac-790353bbd11a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:29.153949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57f6b1a1-3b0a-4e4a-b7ac-790353bbd11a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:29.333811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-57f6b1a1-3b0a-4e4a-b7ac-790353bbd11a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:29.345863 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-57f6b1a1-3b0a-4e4a-b7ac-790353bbd11a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.210944 Apr 12 14:56:29.346451 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 156/303] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:29 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:29.534597 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-00bf437c-3321-485d-a34a-11ac5a9ddba4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:29.535987 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-00bf437c-3321-485d-a34a-11ac5a9ddba4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:29.541932 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-00bf437c-3321-485d-a34a-11ac5a9ddba4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:29.542948 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-00bf437c-3321-485d-a34a-11ac5a9ddba4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:29.543918 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-00bf437c-3321-485d-a34a-11ac5a9ddba4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:29.544422 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-00bf437c-3321-485d-a34a-11ac5a9ddba4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:29.682828 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-00bf437c-3321-485d-a34a-11ac5a9ddba4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:29.690298 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-00bf437c-3321-485d-a34a-11ac5a9ddba4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.160696 Apr 12 14:56:29.690866 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 148/304] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:29 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:29.963102 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-50bdba6d-c1a1-45b2-8f70-44eac05a5924 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:29.963711 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-50bdba6d-c1a1-45b2-8f70-44eac05a5924 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:29.969888 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-50bdba6d-c1a1-45b2-8f70-44eac05a5924 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:29.970336 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-50bdba6d-c1a1-45b2-8f70-44eac05a5924 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:29.971146 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-50bdba6d-c1a1-45b2-8f70-44eac05a5924 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:29.971613 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-50bdba6d-c1a1-45b2-8f70-44eac05a5924 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:30.142455 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-50bdba6d-c1a1-45b2-8f70-44eac05a5924 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:30.151934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-50bdba6d-c1a1-45b2-8f70-44eac05a5924 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:30.153861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-50bdba6d-c1a1-45b2-8f70-44eac05a5924 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:30.155313 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-50bdba6d-c1a1-45b2-8f70-44eac05a5924 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.196531 Apr 12 14:56:30.156056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 157/305] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:29 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:56:30.364491 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-62c4f9ec-49eb-48ac-bc21-f767e9ec7431 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:30.365094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-62c4f9ec-49eb-48ac-bc21-f767e9ec7431 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:30.372332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-62c4f9ec-49eb-48ac-bc21-f767e9ec7431 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:30.372814 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-62c4f9ec-49eb-48ac-bc21-f767e9ec7431 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:30.374080 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-62c4f9ec-49eb-48ac-bc21-f767e9ec7431 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:30.374508 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-62c4f9ec-49eb-48ac-bc21-f767e9ec7431 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:30.525569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-62c4f9ec-49eb-48ac-bc21-f767e9ec7431 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:30.525569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-62c4f9ec-49eb-48ac-bc21-f767e9ec7431 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.163363 Apr 12 14:56:30.525569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 149/306] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:30 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:30.624764 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1245094455", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc73a003-4067-4844-9c4d-7187574c0c62"}], "security_groups": [{"name": "tempest-securitygroup--801745640"}], "key_name": "tempest-keypair-437604112", "user_data": "}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:30.707621 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dbdff556-0fc8-4785-ba38-139ad7d98fe0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:30.708232 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dbdff556-0fc8-4785-ba38-139ad7d98fe0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:30.715006 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbdff556-0fc8-4785-ba38-139ad7d98fe0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:30.718202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbdff556-0fc8-4785-ba38-139ad7d98fe0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:30.719040 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbdff556-0fc8-4785-ba38-139ad7d98fe0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:30.719480 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbdff556-0fc8-4785-ba38-139ad7d98fe0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:30.746034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] validate_networks() for [('bc73a003-4067-4844-9c4d-7187574c0c62', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:56:31.185955 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dbdff556-0fc8-4785-ba38-139ad7d98fe0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:31.195588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dbdff556-0fc8-4785-ba38-139ad7d98fe0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.491950 Apr 12 14:56:31.205960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 150/307] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:30 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:31.211256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-716789385", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:31.270900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] validate_networks() for None {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:56:31.684227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:56:31.684843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:56:31.685372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:56:31.686074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:56:31.688176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:56:31.698095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:56:31.698738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:56:31.699219 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:56:31.699767 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:56:31.700029 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:56:31.702641 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:31.703460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:31.704408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:31.704904 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:31.709683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:31.710126 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:31.713372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:31.713372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:31.724795 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Getting quotas for project 14ab1b96ea0749b7979379be4a0175ec. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:56:31.731386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Getting quotas for user 546c0ce913404721a6981858e34007c0 and project 14ab1b96ea0749b7979379be4a0175ec. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:56:31.735814 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:56:31.737499 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:56:31.744361 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:56:31.746886 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:56:31.749816 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:56:31.752106 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:56:31.889510 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b884ef09-8b39-49be-be75-e5ec2ee04378 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.270688 Apr 12 14:56:31.890496 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 158/308] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:56:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:56:31.895497 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fee05b0c-1fbc-4302-8efe-02db0552a4f6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:31.896187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fee05b0c-1fbc-4302-8efe-02db0552a4f6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:31.905238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fee05b0c-1fbc-4302-8efe-02db0552a4f6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:31.905922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fee05b0c-1fbc-4302-8efe-02db0552a4f6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:31.906721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fee05b0c-1fbc-4302-8efe-02db0552a4f6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:31.907266 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fee05b0c-1fbc-4302-8efe-02db0552a4f6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:31.958586 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fced8817-f9a2-4ef7-822d-eddabc505ea1 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748643 Apr 12 14:56:31.959328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 151/309] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:56:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:56:31.965272 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2e54dee6-b3e6-4946-9fdc-7fdf6e914f4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:31.968538 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2e54dee6-b3e6-4946-9fdc-7fdf6e914f4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:31.978452 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e54dee6-b3e6-4946-9fdc-7fdf6e914f4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:31.983248 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e54dee6-b3e6-4946-9fdc-7fdf6e914f4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:31.984431 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e54dee6-b3e6-4946-9fdc-7fdf6e914f4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:31.985214 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e54dee6-b3e6-4946-9fdc-7fdf6e914f4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:32.214383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fee05b0c-1fbc-4302-8efe-02db0552a4f6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:32.218673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2e54dee6-b3e6-4946-9fdc-7fdf6e914f4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:32.230514 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fee05b0c-1fbc-4302-8efe-02db0552a4f6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:32.232020 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fee05b0c-1fbc-4302-8efe-02db0552a4f6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:32.232526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2e54dee6-b3e6-4946-9fdc-7fdf6e914f4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1723 microversion: 2.1 time: 0.272003 Apr 12 14:56:32.244591 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fee05b0c-1fbc-4302-8efe-02db0552a4f6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.342085 Apr 12 14:56:32.244786 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 152/310] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:31 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:32.244906 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 159/311] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:31 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:32.244906 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c0878d87-71a3-44b8-bdc7-243dca42f76e tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:32.244906 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c0878d87-71a3-44b8-bdc7-243dca42f76e tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:32.249603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9f0e470f-cdb7-43e0-8755-4c02046ccd53 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:32.250269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9f0e470f-cdb7-43e0-8755-4c02046ccd53 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:32.308173 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c0878d87-71a3-44b8-bdc7-243dca42f76e tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:32.315250 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c0878d87-71a3-44b8-bdc7-243dca42f76e tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1214 microversion: 2.1 time: 0.079922 Apr 12 14:56:32.315822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 160/312] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:32 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:32.320653 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-890b6645-a5c0-4eb4-9b14-008e2a1adb77 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:32.321668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-890b6645-a5c0-4eb4-9b14-008e2a1adb77 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:32.326558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9f0e470f-cdb7-43e0-8755-4c02046ccd53 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:32.328973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-890b6645-a5c0-4eb4-9b14-008e2a1adb77 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:32.329419 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-890b6645-a5c0-4eb4-9b14-008e2a1adb77 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:32.330271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-890b6645-a5c0-4eb4-9b14-008e2a1adb77 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:32.330697 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-890b6645-a5c0-4eb4-9b14-008e2a1adb77 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:32.343043 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9f0e470f-cdb7-43e0-8755-4c02046ccd53 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1241 microversion: 2.1 time: 0.100196 Apr 12 14:56:32.343901 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 153/313] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:32 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:32.475893 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-890b6645-a5c0-4eb4-9b14-008e2a1adb77 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:32.485199 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-890b6645-a5c0-4eb4-9b14-008e2a1adb77 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1501 microversion: 2.1 time: 0.168350 Apr 12 14:56:32.485805 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 161/314] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:32 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:32.502556 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77b0b0b8-a061-4174-a675-001a4faaa0b1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffc83327-bea1-461b-be39-ee4897ecf44f"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:32.504661 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-77b0b0b8-a061-4174-a675-001a4faaa0b1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:32.513490 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77b0b0b8-a061-4174-a675-001a4faaa0b1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:32.513978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77b0b0b8-a061-4174-a675-001a4faaa0b1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:32.514760 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77b0b0b8-a061-4174-a675-001a4faaa0b1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:32.515189 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77b0b0b8-a061-4174-a675-001a4faaa0b1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:32.540773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-77b0b0b8-a061-4174-a675-001a4faaa0b1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] HTTP exception thrown: Cannot 'attach_volume' instance 92e6b586-ce02-4394-a2a1-6ae5e0f09306 while it is in vm_state rescued Apr 12 14:56:32.541462 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77b0b0b8-a061-4174-a675-001a4faaa0b1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Returning 409 to user: Cannot 'attach_volume' instance 92e6b586-ce02-4394-a2a1-6ae5e0f09306 while it is in vm_state rescued {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:56:32.542359 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-77b0b0b8-a061-4174-a675-001a4faaa0b1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044209 Apr 12 14:56:32.543098 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 154/315] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 14:56:32 2022] POST /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 14:56:32.553152 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8fc02762-b89c-4caa-ab2e-b1988f567df0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:32.553826 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8fc02762-b89c-4caa-ab2e-b1988f567df0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:32.560694 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fc02762-b89c-4caa-ab2e-b1988f567df0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:32.561402 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fc02762-b89c-4caa-ab2e-b1988f567df0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:32.562213 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fc02762-b89c-4caa-ab2e-b1988f567df0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:32.562647 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fc02762-b89c-4caa-ab2e-b1988f567df0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:32.859906 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8fc02762-b89c-4caa-ab2e-b1988f567df0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306/action" status: 202 len: 0 microversion: 2.1 time: 0.311372 Apr 12 14:56:32.860600 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 162/316] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 14:56:32 2022] POST /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:56:32.868890 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1559c7bd-9699-4c88-bfaf-ab76991da7c6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:32.869496 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1559c7bd-9699-4c88-bfaf-ab76991da7c6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:32.876009 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1559c7bd-9699-4c88-bfaf-ab76991da7c6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:32.876467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1559c7bd-9699-4c88-bfaf-ab76991da7c6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:32.877261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1559c7bd-9699-4c88-bfaf-ab76991da7c6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:32.877728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1559c7bd-9699-4c88-bfaf-ab76991da7c6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.024340 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1559c7bd-9699-4c88-bfaf-ab76991da7c6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:33.032128 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1559c7bd-9699-4c88-bfaf-ab76991da7c6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1509 microversion: 2.1 time: 0.167041 Apr 12 14:56:33.032761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 155/317] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:32 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:33.263753 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2ffaf234-5a36-4f31-b088-341ff77597a9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:33.266317 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e676e042-c945-422c-b467-41d534aec538 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:33.267010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e676e042-c945-422c-b467-41d534aec538 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:33.268652 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2ffaf234-5a36-4f31-b088-341ff77597a9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:33.277104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e676e042-c945-422c-b467-41d534aec538 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.277472 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e676e042-c945-422c-b467-41d534aec538 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.277657 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ffaf234-5a36-4f31-b088-341ff77597a9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.278278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ffaf234-5a36-4f31-b088-341ff77597a9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.278423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e676e042-c945-422c-b467-41d534aec538 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.278735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e676e042-c945-422c-b467-41d534aec538 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.279562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ffaf234-5a36-4f31-b088-341ff77597a9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.280134 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ffaf234-5a36-4f31-b088-341ff77597a9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.553339 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2ffaf234-5a36-4f31-b088-341ff77597a9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:33.557959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e676e042-c945-422c-b467-41d534aec538 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:33.563319 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2ffaf234-5a36-4f31-b088-341ff77597a9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:33.565164 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2ffaf234-5a36-4f31-b088-341ff77597a9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:33.566177 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e676e042-c945-422c-b467-41d534aec538 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1700 microversion: 2.1 time: 0.311171 Apr 12 14:56:33.566772 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 163/318] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:33 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1700 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:33.574479 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fc374010-1926-4234-a0c8-a8f18afae3e4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:33.577052 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fc374010-1926-4234-a0c8-a8f18afae3e4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:33.581151 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2ffaf234-5a36-4f31-b088-341ff77597a9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.321453 Apr 12 14:56:33.582094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 156/319] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:33 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:33.588829 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-49ccfb27-2cbf-4a57-a410-143f3aa75825 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:33.590323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-49ccfb27-2cbf-4a57-a410-143f3aa75825 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:33.598235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49ccfb27-2cbf-4a57-a410-143f3aa75825 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.599036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49ccfb27-2cbf-4a57-a410-143f3aa75825 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.600296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49ccfb27-2cbf-4a57-a410-143f3aa75825 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.600980 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49ccfb27-2cbf-4a57-a410-143f3aa75825 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.611747 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc374010-1926-4234-a0c8-a8f18afae3e4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.612288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc374010-1926-4234-a0c8-a8f18afae3e4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.613443 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc374010-1926-4234-a0c8-a8f18afae3e4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.613920 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc374010-1926-4234-a0c8-a8f18afae3e4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.700862 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-49ccfb27-2cbf-4a57-a410-143f3aa75825 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:33.708994 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-49ccfb27-2cbf-4a57-a410-143f3aa75825 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1237 microversion: 2.1 time: 0.125501 Apr 12 14:56:33.709581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 157/320] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:33 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1237 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:33.725239 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0e69b277-ecbd-404c-8869-ed04d97ff9d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:33.725832 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fc374010-1926-4234-a0c8-a8f18afae3e4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:33.731922 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e69b277-ecbd-404c-8869-ed04d97ff9d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.732369 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e69b277-ecbd-404c-8869-ed04d97ff9d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.735726 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fc374010-1926-4234-a0c8-a8f18afae3e4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1218 microversion: 2.1 time: 0.166837 Apr 12 14:56:33.736591 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 164/321] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:33 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:33.764075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0e69b277-ecbd-404c-8869-ed04d97ff9d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Going to try to start instance {{(pid=124199) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 12 14:56:33.939398 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0e69b277-ecbd-404c-8869-ed04d97ff9d9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/action" status: 202 len: 0 microversion: 2.1 time: 0.218448 Apr 12 14:56:33.940048 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 158/322] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 14:56:33 2022] POST /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:56:33.950470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-edf38658-90c9-44c0-94bc-2694507858e6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:33.951421 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-edf38658-90c9-44c0-94bc-2694507858e6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:33.969014 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-edf38658-90c9-44c0-94bc-2694507858e6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.969587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-edf38658-90c9-44c0-94bc-2694507858e6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:33.971080 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-edf38658-90c9-44c0-94bc-2694507858e6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:33.971773 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-edf38658-90c9-44c0-94bc-2694507858e6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:34.052277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cf78f5c6-938c-4aef-a908-9b3b9c917338 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:34.052899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cf78f5c6-938c-4aef-a908-9b3b9c917338 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:34.062027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf78f5c6-938c-4aef-a908-9b3b9c917338 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:34.062710 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf78f5c6-938c-4aef-a908-9b3b9c917338 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:34.063490 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf78f5c6-938c-4aef-a908-9b3b9c917338 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:34.063920 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf78f5c6-938c-4aef-a908-9b3b9c917338 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:34.122923 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-edf38658-90c9-44c0-94bc-2694507858e6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:34.131748 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-edf38658-90c9-44c0-94bc-2694507858e6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1709 microversion: 2.1 time: 0.187191 Apr 12 14:56:34.132595 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 165/323] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:33 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1709 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:34.240225 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cf78f5c6-938c-4aef-a908-9b3b9c917338 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:34.249029 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cf78f5c6-938c-4aef-a908-9b3b9c917338 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1509 microversion: 2.1 time: 0.202313 Apr 12 14:56:34.249594 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 159/324] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:34 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:34.600923 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-415351d8-2ce3-4ee2-92dd-f67b5b1d80a8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:34.601768 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-415351d8-2ce3-4ee2-92dd-f67b5b1d80a8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:34.609423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-415351d8-2ce3-4ee2-92dd-f67b5b1d80a8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:34.609981 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-415351d8-2ce3-4ee2-92dd-f67b5b1d80a8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:34.610877 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-415351d8-2ce3-4ee2-92dd-f67b5b1d80a8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:34.611443 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-415351d8-2ce3-4ee2-92dd-f67b5b1d80a8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:34.726735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-29399fe3-490d-4662-bf0c-ddb5f260b750 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:34.727987 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-29399fe3-490d-4662-bf0c-ddb5f260b750 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:34.735287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-29399fe3-490d-4662-bf0c-ddb5f260b750 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:34.735734 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-29399fe3-490d-4662-bf0c-ddb5f260b750 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:34.736512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-29399fe3-490d-4662-bf0c-ddb5f260b750 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:34.736941 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-29399fe3-490d-4662-bf0c-ddb5f260b750 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:34.756241 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-415351d8-2ce3-4ee2-92dd-f67b5b1d80a8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:34.764408 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-415351d8-2ce3-4ee2-92dd-f67b5b1d80a8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:34.765950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-415351d8-2ce3-4ee2-92dd-f67b5b1d80a8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:34.767111 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-415351d8-2ce3-4ee2-92dd-f67b5b1d80a8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.170173 Apr 12 14:56:34.768012 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 166/325] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:34 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:34.772581 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-42b14a48-7b34-4312-bbe7-f0e0b3f76eaf tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:34.773192 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-42b14a48-7b34-4312-bbe7-f0e0b3f76eaf tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:34.780892 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42b14a48-7b34-4312-bbe7-f0e0b3f76eaf tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:34.781338 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42b14a48-7b34-4312-bbe7-f0e0b3f76eaf tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:34.782159 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42b14a48-7b34-4312-bbe7-f0e0b3f76eaf tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:34.782593 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42b14a48-7b34-4312-bbe7-f0e0b3f76eaf tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:34.801220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-29399fe3-490d-4662-bf0c-ddb5f260b750 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:34.809088 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-29399fe3-490d-4662-bf0c-ddb5f260b750 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1301 microversion: 2.1 time: 0.086063 Apr 12 14:56:34.809691 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 160/326] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:34 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:34.856723 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-42b14a48-7b34-4312-bbe7-f0e0b3f76eaf tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:34.866618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-42b14a48-7b34-4312-bbe7-f0e0b3f76eaf tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1266 microversion: 2.1 time: 0.097116 Apr 12 14:56:34.868251 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 167/327] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:34 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:35.151497 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2abbf772-bcca-4032-bb5c-8a80a99aaf56 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:35.152091 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2abbf772-bcca-4032-bb5c-8a80a99aaf56 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:35.158125 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2abbf772-bcca-4032-bb5c-8a80a99aaf56 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:35.161853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2abbf772-bcca-4032-bb5c-8a80a99aaf56 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:35.161853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2abbf772-bcca-4032-bb5c-8a80a99aaf56 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:35.161853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2abbf772-bcca-4032-bb5c-8a80a99aaf56 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:35.269485 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-94687648-d014-4337-be65-bc9eccc7227f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:35.270802 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-94687648-d014-4337-be65-bc9eccc7227f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:35.280340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94687648-d014-4337-be65-bc9eccc7227f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:35.280340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94687648-d014-4337-be65-bc9eccc7227f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:35.280340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94687648-d014-4337-be65-bc9eccc7227f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:35.280340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94687648-d014-4337-be65-bc9eccc7227f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:35.314421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2abbf772-bcca-4032-bb5c-8a80a99aaf56 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:35.323939 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2abbf772-bcca-4032-bb5c-8a80a99aaf56 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1709 microversion: 2.1 time: 0.176791 Apr 12 14:56:35.324996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 161/328] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:35 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1709 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:35.428311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-94687648-d014-4337-be65-bc9eccc7227f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:35.436954 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-94687648-d014-4337-be65-bc9eccc7227f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1509 microversion: 2.1 time: 0.171573 Apr 12 14:56:35.437529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 168/329] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:35 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:35.786653 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-253dc657-b18f-4b55-b456-0a39623ef386 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:35.787731 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-253dc657-b18f-4b55-b456-0a39623ef386 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:35.796116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-253dc657-b18f-4b55-b456-0a39623ef386 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:35.796568 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-253dc657-b18f-4b55-b456-0a39623ef386 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:35.797588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-253dc657-b18f-4b55-b456-0a39623ef386 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:35.798956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-253dc657-b18f-4b55-b456-0a39623ef386 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:35.827467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dee055a9-f4aa-4fca-bb08-b3b1d187a45a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:35.831869 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dee055a9-f4aa-4fca-bb08-b3b1d187a45a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:35.847691 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dee055a9-f4aa-4fca-bb08-b3b1d187a45a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:35.848939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dee055a9-f4aa-4fca-bb08-b3b1d187a45a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:35.850378 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dee055a9-f4aa-4fca-bb08-b3b1d187a45a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:35.850816 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dee055a9-f4aa-4fca-bb08-b3b1d187a45a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:35.938209 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dee055a9-f4aa-4fca-bb08-b3b1d187a45a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:35.948918 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dee055a9-f4aa-4fca-bb08-b3b1d187a45a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1301 microversion: 2.1 time: 0.125952 Apr 12 14:56:35.950229 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 169/330] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:35 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1301 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:35.957112 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-52d7293a-e589-46cb-ba9f-dba72f4293c4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:35.958025 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-52d7293a-e589-46cb-ba9f-dba72f4293c4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:35.964760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-52d7293a-e589-46cb-ba9f-dba72f4293c4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:35.965202 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-52d7293a-e589-46cb-ba9f-dba72f4293c4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:35.966016 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-52d7293a-e589-46cb-ba9f-dba72f4293c4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:35.966446 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-52d7293a-e589-46cb-ba9f-dba72f4293c4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:36.017427 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-253dc657-b18f-4b55-b456-0a39623ef386 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:36.026783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-253dc657-b18f-4b55-b456-0a39623ef386 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:36.028271 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-253dc657-b18f-4b55-b456-0a39623ef386 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:36.029545 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-253dc657-b18f-4b55-b456-0a39623ef386 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.246674 Apr 12 14:56:36.030106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 162/331] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:35 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:36.038959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-52d7293a-e589-46cb-ba9f-dba72f4293c4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:36.048849 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-52d7293a-e589-46cb-ba9f-dba72f4293c4 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1274 microversion: 2.1 time: 0.095966 Apr 12 14:56:36.049534 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 170/332] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:35 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:36.348498 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-822ef9f2-0439-4a82-bb4a-a79cab21f657 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:36.350946 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-822ef9f2-0439-4a82-bb4a-a79cab21f657 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:36.358063 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-822ef9f2-0439-4a82-bb4a-a79cab21f657 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:36.358515 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-822ef9f2-0439-4a82-bb4a-a79cab21f657 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:36.359300 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-822ef9f2-0439-4a82-bb4a-a79cab21f657 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:36.359874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-822ef9f2-0439-4a82-bb4a-a79cab21f657 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:36.455451 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8736613e-309e-4d48-ba90-9fdff6ae7520 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:36.456056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8736613e-309e-4d48-ba90-9fdff6ae7520 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:36.462780 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8736613e-309e-4d48-ba90-9fdff6ae7520 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:36.463281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8736613e-309e-4d48-ba90-9fdff6ae7520 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:36.464138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8736613e-309e-4d48-ba90-9fdff6ae7520 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:36.464579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8736613e-309e-4d48-ba90-9fdff6ae7520 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:36.554278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-822ef9f2-0439-4a82-bb4a-a79cab21f657 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:36.564552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-822ef9f2-0439-4a82-bb4a-a79cab21f657 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1709 microversion: 2.1 time: 0.222201 Apr 12 14:56:36.565908 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 163/333] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:36 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1709 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:36.676833 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8736613e-309e-4d48-ba90-9fdff6ae7520 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:36.685495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8736613e-309e-4d48-ba90-9fdff6ae7520 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1515 microversion: 2.1 time: 0.233717 Apr 12 14:56:36.685973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 171/334] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:36 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:36.967375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1bad4e04-82d9-49bc-bbdf-6f54d690bee6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:36.967977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1bad4e04-82d9-49bc-bbdf-6f54d690bee6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:36.974885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bad4e04-82d9-49bc-bbdf-6f54d690bee6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:36.975324 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bad4e04-82d9-49bc-bbdf-6f54d690bee6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:36.976108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bad4e04-82d9-49bc-bbdf-6f54d690bee6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:36.976534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1bad4e04-82d9-49bc-bbdf-6f54d690bee6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:37.042433 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1bad4e04-82d9-49bc-bbdf-6f54d690bee6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:37.051576 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1bad4e04-82d9-49bc-bbdf-6f54d690bee6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1299 microversion: 2.1 time: 0.088211 Apr 12 14:56:37.052150 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 164/335] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:36 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:37.066772 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b0582e4d-e3ad-47a6-8851-ae0deeaa330f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:37.067587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b0582e4d-e3ad-47a6-8851-ae0deeaa330f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:37.080219 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d293b2a0-438c-48c4-aeb8-d46fc410be74 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:37.088242 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d293b2a0-438c-48c4-aeb8-d46fc410be74 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:37.090023 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0582e4d-e3ad-47a6-8851-ae0deeaa330f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:37.090959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0582e4d-e3ad-47a6-8851-ae0deeaa330f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:37.092258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0582e4d-e3ad-47a6-8851-ae0deeaa330f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:37.095799 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0582e4d-e3ad-47a6-8851-ae0deeaa330f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:37.097512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d293b2a0-438c-48c4-aeb8-d46fc410be74 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:37.098143 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d293b2a0-438c-48c4-aeb8-d46fc410be74 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:37.099682 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d293b2a0-438c-48c4-aeb8-d46fc410be74 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:37.099682 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d293b2a0-438c-48c4-aeb8-d46fc410be74 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:37.213744 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d293b2a0-438c-48c4-aeb8-d46fc410be74 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:37.234383 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d293b2a0-438c-48c4-aeb8-d46fc410be74 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1272 microversion: 2.1 time: 0.158221 Apr 12 14:56:37.249666 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 165/336] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:37 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:37.294046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b0582e4d-e3ad-47a6-8851-ae0deeaa330f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:37.302760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b0582e4d-e3ad-47a6-8851-ae0deeaa330f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:37.304264 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b0582e4d-e3ad-47a6-8851-ae0deeaa330f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:37.306697 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b0582e4d-e3ad-47a6-8851-ae0deeaa330f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1744 microversion: 2.20 time: 0.261784 Apr 12 14:56:37.318328 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 172/337] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:37 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1744 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:56:37.584465 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ee1bccef-b446-4a67-a090-5d08cf054069 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:37.585227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ee1bccef-b446-4a67-a090-5d08cf054069 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:37.592243 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee1bccef-b446-4a67-a090-5d08cf054069 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:37.592899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee1bccef-b446-4a67-a090-5d08cf054069 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:37.593983 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee1bccef-b446-4a67-a090-5d08cf054069 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:37.595196 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee1bccef-b446-4a67-a090-5d08cf054069 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:37.783988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ee1bccef-b446-4a67-a090-5d08cf054069 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:37.796100 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ee1bccef-b446-4a67-a090-5d08cf054069 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1709 microversion: 2.1 time: 0.215925 Apr 12 14:56:37.796687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 166/338] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:37 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1709 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:38.074505 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2c947ff1-5881-4aef-84c1-f42eb0392555 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:38.075121 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2c947ff1-5881-4aef-84c1-f42eb0392555 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:38.082242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c947ff1-5881-4aef-84c1-f42eb0392555 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:38.082687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c947ff1-5881-4aef-84c1-f42eb0392555 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:38.083645 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c947ff1-5881-4aef-84c1-f42eb0392555 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:38.084402 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c947ff1-5881-4aef-84c1-f42eb0392555 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:38.238035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2c947ff1-5881-4aef-84c1-f42eb0392555 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:38.248690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2c947ff1-5881-4aef-84c1-f42eb0392555 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.182042 Apr 12 14:56:38.249720 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 173/339] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:38 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:38.255526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c2a81874-370d-4e89-9da3-d6342f90142f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:38.256227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c2a81874-370d-4e89-9da3-d6342f90142f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:38.263156 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2a81874-370d-4e89-9da3-d6342f90142f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:38.263598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2a81874-370d-4e89-9da3-d6342f90142f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:38.264620 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2a81874-370d-4e89-9da3-d6342f90142f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:38.265097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2a81874-370d-4e89-9da3-d6342f90142f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:38.330855 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c9ab9140-54da-4f01-8a4d-ca05de3aa8c4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:38.331822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c9ab9140-54da-4f01-8a4d-ca05de3aa8c4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:38.345460 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9ab9140-54da-4f01-8a4d-ca05de3aa8c4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:38.346644 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9ab9140-54da-4f01-8a4d-ca05de3aa8c4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:38.348111 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9ab9140-54da-4f01-8a4d-ca05de3aa8c4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:38.349619 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9ab9140-54da-4f01-8a4d-ca05de3aa8c4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:38.624929 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c2a81874-370d-4e89-9da3-d6342f90142f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:38.638525 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c2a81874-370d-4e89-9da3-d6342f90142f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.386675 Apr 12 14:56:38.639806 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 167/340] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:38 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:38.655503 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-23daa0b8-ce23-49c7-bd95-d271b577415c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'create', calling method: .version_select at 0x7fbd60a37550>, body: {"keypair": {"name": "tempest-keypair-32305355"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:38.688011 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c9ab9140-54da-4f01-8a4d-ca05de3aa8c4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:38.688222 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-23daa0b8-ce23-49c7-bd95-d271b577415c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Getting quotas for project 566788e9e53f44db92dfad7ee91d6cd2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:56:38.692673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-23daa0b8-ce23-49c7-bd95-d271b577415c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Getting quotas for user fb985e9c053f4c379f14c7ac21fb89bb and project 566788e9e53f44db92dfad7ee91d6cd2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:56:38.693938 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c9ab9140-54da-4f01-8a4d-ca05de3aa8c4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:38.696577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c9ab9140-54da-4f01-8a4d-ca05de3aa8c4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:38.703608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c9ab9140-54da-4f01-8a4d-ca05de3aa8c4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1744 microversion: 2.20 time: 0.375218 Apr 12 14:56:38.714462 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 174/341] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:38 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1744 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:56:38.814266 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ae248eb6-5f9e-4787-aa73-79cf18555341 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:38.815623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ae248eb6-5f9e-4787-aa73-79cf18555341 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:38.825800 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae248eb6-5f9e-4787-aa73-79cf18555341 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:38.826505 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae248eb6-5f9e-4787-aa73-79cf18555341 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:38.827719 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae248eb6-5f9e-4787-aa73-79cf18555341 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:38.828931 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae248eb6-5f9e-4787-aa73-79cf18555341 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:39.038288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ae248eb6-5f9e-4787-aa73-79cf18555341 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:39.052913 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ae248eb6-5f9e-4787-aa73-79cf18555341 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1709 microversion: 2.1 time: 0.242846 Apr 12 14:56:39.053491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 175/342] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:38 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1709 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:39.082207 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-23daa0b8-ce23-49c7-bd95-d271b577415c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Getting quotas for project 566788e9e53f44db92dfad7ee91d6cd2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:56:39.092747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-23daa0b8-ce23-49c7-bd95-d271b577415c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Getting quotas for user fb985e9c053f4c379f14c7ac21fb89bb and project 566788e9e53f44db92dfad7ee91d6cd2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:56:39.113965 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-23daa0b8-ce23-49c7-bd95-d271b577415c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.472182 Apr 12 14:56:39.114724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 168/343] 10.222.0.64 () {60 vars in 1157 bytes} [Tue Apr 12 14:56:38 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:39.265929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c0deb753-79a8-4bf9-8efd-5911a313eb72 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:39.266557 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c0deb753-79a8-4bf9-8efd-5911a313eb72 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:39.282699 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c0deb753-79a8-4bf9-8efd-5911a313eb72 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:39.283159 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c0deb753-79a8-4bf9-8efd-5911a313eb72 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:39.284268 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c0deb753-79a8-4bf9-8efd-5911a313eb72 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:39.284941 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c0deb753-79a8-4bf9-8efd-5911a313eb72 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:39.504671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c0deb753-79a8-4bf9-8efd-5911a313eb72 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:39.521205 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-4348b824-a605-47d2-80f0-07a898d94b31 req-ea943630-2053-403c-a4f1-af0ceaa49782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a709c0e8-54c5-43a2-a065-4ee9445449c9", "tag": "d3c74b15-1916-4ae7-bef5-d2dee4e37164"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:39.536598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-4348b824-a605-47d2-80f0-07a898d94b31 req-ea943630-2053-403c-a4f1-af0ceaa49782 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:39.537269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-4348b824-a605-47d2-80f0-07a898d94b31 req-ea943630-2053-403c-a4f1-af0ceaa49782 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:39.538334 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c0deb753-79a8-4bf9-8efd-5911a313eb72 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.275510 Apr 12 14:56:39.539171 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 176/344] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:39 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:39.563244 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-4348b824-a605-47d2-80f0-07a898d94b31 req-ea943630-2053-403c-a4f1-af0ceaa49782 service nova] Creating event network-changed:d3c74b15-1916-4ae7-bef5-d2dee4e37164 for instance a709c0e8-54c5-43a2-a065-4ee9445449c9 on hv-cinder-83752 Apr 12 14:56:39.572118 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-4348b824-a605-47d2-80f0-07a898d94b31 req-ea943630-2053-403c-a4f1-af0ceaa49782 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054410 Apr 12 14:56:39.573894 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 169/345] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:56:39.656615 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-72c39f81-a88d-45ec-b9e4-ab9272c88b19 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:39.657223 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-72c39f81-a88d-45ec-b9e4-ab9272c88b19 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:39.668672 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-72c39f81-a88d-45ec-b9e4-ab9272c88b19 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:39.669292 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-72c39f81-a88d-45ec-b9e4-ab9272c88b19 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:39.670726 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-72c39f81-a88d-45ec-b9e4-ab9272c88b19 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:39.671152 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-72c39f81-a88d-45ec-b9e4-ab9272c88b19 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:39.724305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-471ab527-6a8d-4c5b-9781-ecf8e305e6e0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:39.725864 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-471ab527-6a8d-4c5b-9781-ecf8e305e6e0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:39.735691 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-471ab527-6a8d-4c5b-9781-ecf8e305e6e0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:39.736287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-471ab527-6a8d-4c5b-9781-ecf8e305e6e0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:39.737874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-471ab527-6a8d-4c5b-9781-ecf8e305e6e0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:39.738379 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-471ab527-6a8d-4c5b-9781-ecf8e305e6e0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:39.959869 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-72c39f81-a88d-45ec-b9e4-ab9272c88b19 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:39.970211 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-72c39f81-a88d-45ec-b9e4-ab9272c88b19 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.317464 Apr 12 14:56:39.970812 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 177/346] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:39 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:40.006998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-471ab527-6a8d-4c5b-9781-ecf8e305e6e0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:40.018002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-471ab527-6a8d-4c5b-9781-ecf8e305e6e0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:40.019558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-471ab527-6a8d-4c5b-9781-ecf8e305e6e0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:40.020755 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-471ab527-6a8d-4c5b-9781-ecf8e305e6e0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.301226 Apr 12 14:56:40.021324 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 170/347] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:39 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:40.071134 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c9b76ba7-6344-4728-9179-fcb98fb89cf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:40.072046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c9b76ba7-6344-4728-9179-fcb98fb89cf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:40.078887 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9b76ba7-6344-4728-9179-fcb98fb89cf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:40.079428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9b76ba7-6344-4728-9179-fcb98fb89cf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:40.080285 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9b76ba7-6344-4728-9179-fcb98fb89cf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:40.080789 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9b76ba7-6344-4728-9179-fcb98fb89cf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:40.253983 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c9b76ba7-6344-4728-9179-fcb98fb89cf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:40.267522 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c9b76ba7-6344-4728-9179-fcb98fb89cf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1713 microversion: 2.1 time: 0.200791 Apr 12 14:56:40.268122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 178/348] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:40 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1713 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:40.563425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-99a46e13-db5f-4a7b-a302-cad3c720c087 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:40.563958 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-99a46e13-db5f-4a7b-a302-cad3c720c087 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:40.571386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99a46e13-db5f-4a7b-a302-cad3c720c087 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:40.571899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99a46e13-db5f-4a7b-a302-cad3c720c087 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:40.572684 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99a46e13-db5f-4a7b-a302-cad3c720c087 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:40.573120 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99a46e13-db5f-4a7b-a302-cad3c720c087 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:40.711878 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-99a46e13-db5f-4a7b-a302-cad3c720c087 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:40.719596 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-99a46e13-db5f-4a7b-a302-cad3c720c087 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.160106 Apr 12 14:56:40.720174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 171/349] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:40 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:40.988551 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d90a8ced-e2ed-4288-b6cd-5ec6d0ba87bb tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:40.989162 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d90a8ced-e2ed-4288-b6cd-5ec6d0ba87bb tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:40.996401 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d90a8ced-e2ed-4288-b6cd-5ec6d0ba87bb tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:40.996846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d90a8ced-e2ed-4288-b6cd-5ec6d0ba87bb tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:40.997618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d90a8ced-e2ed-4288-b6cd-5ec6d0ba87bb tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:40.998078 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d90a8ced-e2ed-4288-b6cd-5ec6d0ba87bb tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:41.041301 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5224acc6-0465-480f-9285-6b993957ddce tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:41.042467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5224acc6-0465-480f-9285-6b993957ddce tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:41.051502 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5224acc6-0465-480f-9285-6b993957ddce tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:41.051959 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5224acc6-0465-480f-9285-6b993957ddce tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:41.052892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5224acc6-0465-480f-9285-6b993957ddce tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:41.053714 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5224acc6-0465-480f-9285-6b993957ddce tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:41.177918 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d90a8ced-e2ed-4288-b6cd-5ec6d0ba87bb tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:41.185941 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d90a8ced-e2ed-4288-b6cd-5ec6d0ba87bb tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.201400 Apr 12 14:56:41.186930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 179/350] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:40 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:41.229844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5224acc6-0465-480f-9285-6b993957ddce tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:41.239720 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5224acc6-0465-480f-9285-6b993957ddce tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:41.241209 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5224acc6-0465-480f-9285-6b993957ddce tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:41.242898 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5224acc6-0465-480f-9285-6b993957ddce tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.206589 Apr 12 14:56:41.244105 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 172/351] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:41 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:56:41.589336 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-1d176c10-2fef-4e49-85e1-b6ae39b4853b req-0341fa5f-6efd-4696-86e2-ebcbc9d4df15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d269e33-8e2d-4352-ba0f-c6d1470ca3fe", "tag": "673fcf47-27a7-4822-bdb5-6b9a776150bc"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:41.597433 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-1d176c10-2fef-4e49-85e1-b6ae39b4853b req-0341fa5f-6efd-4696-86e2-ebcbc9d4df15 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:41.597896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-1d176c10-2fef-4e49-85e1-b6ae39b4853b req-0341fa5f-6efd-4696-86e2-ebcbc9d4df15 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:41.610369 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-1d176c10-2fef-4e49-85e1-b6ae39b4853b req-0341fa5f-6efd-4696-86e2-ebcbc9d4df15 service nova] Creating event network-changed:673fcf47-27a7-4822-bdb5-6b9a776150bc for instance 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe on hv-cinder-83752 Apr 12 14:56:41.615335 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-1d176c10-2fef-4e49-85e1-b6ae39b4853b req-0341fa5f-6efd-4696-86e2-ebcbc9d4df15 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030232 Apr 12 14:56:41.615930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 180/352] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:56:41.736501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d89a83ec-de28-4acd-bfed-41ac08fcf9df tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:41.737036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d89a83ec-de28-4acd-bfed-41ac08fcf9df tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:41.744469 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d89a83ec-de28-4acd-bfed-41ac08fcf9df tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:41.744907 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d89a83ec-de28-4acd-bfed-41ac08fcf9df tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:41.745738 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d89a83ec-de28-4acd-bfed-41ac08fcf9df tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:41.746166 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d89a83ec-de28-4acd-bfed-41ac08fcf9df tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:41.879527 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d89a83ec-de28-4acd-bfed-41ac08fcf9df tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:41.888468 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d89a83ec-de28-4acd-bfed-41ac08fcf9df tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.154808 Apr 12 14:56:41.888468 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 173/353] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:41 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:42.179224 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-655013461", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f7bb313-4e99-4c79-b5eb-bf23757b656e"}], "security_groups": [{"name": "tempest-securitygroup--1931491677"}], "key_name": "tempest-keypair-32305355", "user_data": "}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:42.204907 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7fc2b7c1-b267-4e29-a7cc-095c077cee45 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:42.205596 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7fc2b7c1-b267-4e29-a7cc-095c077cee45 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:42.230491 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7fc2b7c1-b267-4e29-a7cc-095c077cee45 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:42.230950 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7fc2b7c1-b267-4e29-a7cc-095c077cee45 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:42.231765 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7fc2b7c1-b267-4e29-a7cc-095c077cee45 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:42.232202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7fc2b7c1-b267-4e29-a7cc-095c077cee45 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:42.423276 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] validate_networks() for [('8f7bb313-4e99-4c79-b5eb-bf23757b656e', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:56:42.578481 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7fc2b7c1-b267-4e29-a7cc-095c077cee45 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:42.587964 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7fc2b7c1-b267-4e29-a7cc-095c077cee45 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.387805 Apr 12 14:56:42.589328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 174/354] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:42 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:42.602193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d45b203d-8766-4371-9d80-e523ed01fe4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:42.602975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d45b203d-8766-4371-9d80-e523ed01fe4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:42.611198 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d45b203d-8766-4371-9d80-e523ed01fe4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:42.612030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d45b203d-8766-4371-9d80-e523ed01fe4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:42.613049 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d45b203d-8766-4371-9d80-e523ed01fe4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:42.613687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d45b203d-8766-4371-9d80-e523ed01fe4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:42.907197 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d45b203d-8766-4371-9d80-e523ed01fe4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:42.916256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d45b203d-8766-4371-9d80-e523ed01fe4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:42.920771 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d45b203d-8766-4371-9d80-e523ed01fe4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:42.924246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d45b203d-8766-4371-9d80-e523ed01fe4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.333572 Apr 12 14:56:42.926945 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 175/355] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:42 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:42.932777 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-8ff48be5-b182-4bca-a5cc-9ec703e91227 req-a8256b9c-961f-4f63-9bb4-f94fd8188e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d03f42e-2d51-459d-ade0-7e6a34283867", "name": "network-vif-plugged", "status": "completed", "tag": "90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:42.957174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-8ff48be5-b182-4bca-a5cc-9ec703e91227 req-a8256b9c-961f-4f63-9bb4-f94fd8188e02 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:42.965410 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-8ff48be5-b182-4bca-a5cc-9ec703e91227 req-a8256b9c-961f-4f63-9bb4-f94fd8188e02 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:42.986971 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-8ff48be5-b182-4bca-a5cc-9ec703e91227 req-a8256b9c-961f-4f63-9bb4-f94fd8188e02 service nova] Creating event network-vif-plugged:90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77 for instance 9d03f42e-2d51-459d-ade0-7e6a34283867 on hv-cinder-83752 Apr 12 14:56:43.004371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-8ff48be5-b182-4bca-a5cc-9ec703e91227 req-a8256b9c-961f-4f63-9bb4-f94fd8188e02 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075743 Apr 12 14:56:43.008506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 176/356] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:56:43.015684 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-764ad256-3367-4340-8485-fcbee135a8e2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:43.024108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-764ad256-3367-4340-8485-fcbee135a8e2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:43.030941 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-764ad256-3367-4340-8485-fcbee135a8e2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:43.033558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-764ad256-3367-4340-8485-fcbee135a8e2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:43.034996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-764ad256-3367-4340-8485-fcbee135a8e2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:43.034996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-764ad256-3367-4340-8485-fcbee135a8e2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:43.482250 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-764ad256-3367-4340-8485-fcbee135a8e2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:43.489724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-764ad256-3367-4340-8485-fcbee135a8e2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.479668 Apr 12 14:56:43.501685 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 177/357] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:43 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:43.503180 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:56:43.503657 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:56:43.504089 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:56:43.504791 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:56:43.505962 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:56:43.518494 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:43.519286 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:43.520437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:43.521109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:43.563604 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Getting quotas for project 566788e9e53f44db92dfad7ee91d6cd2. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:56:43.566996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Getting quotas for user fb985e9c053f4c379f14c7ac21fb89bb and project 566788e9e53f44db92dfad7ee91d6cd2. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:56:43.587883 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:56:43.590835 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:56:43.605523 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4ec661cc-dddd-4f13-a555-97877ad97e8d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:43.606865 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4ec661cc-dddd-4f13-a555-97877ad97e8d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:43.613714 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ec661cc-dddd-4f13-a555-97877ad97e8d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:43.614597 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ec661cc-dddd-4f13-a555-97877ad97e8d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:43.616445 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ec661cc-dddd-4f13-a555-97877ad97e8d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:43.617326 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ec661cc-dddd-4f13-a555-97877ad97e8d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:43.781193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a39c3f68-9687-43b4-9dca-5c3f1acbf882 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.614002 Apr 12 14:56:43.792211 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4ec661cc-dddd-4f13-a555-97877ad97e8d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:43.793393 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 181/358] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:56:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:56:43.801212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4ec661cc-dddd-4f13-a555-97877ad97e8d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.200372 Apr 12 14:56:43.803729 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0a26e1a6-2477-4daa-8c40-beeffc28a925 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:43.804548 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0a26e1a6-2477-4daa-8c40-beeffc28a925 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:43.812905 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 178/359] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:43 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:43.878095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0a26e1a6-2477-4daa-8c40-beeffc28a925 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:43.887765 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0a26e1a6-2477-4daa-8c40-beeffc28a925 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1243 microversion: 2.1 time: 0.088358 Apr 12 14:56:43.892379 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 182/360] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:43 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1243 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:43.945984 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-468c6ddf-acb5-4afa-9c54-ec76750d6946 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:43.947298 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-468c6ddf-acb5-4afa-9c54-ec76750d6946 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:43.954190 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-468c6ddf-acb5-4afa-9c54-ec76750d6946 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:43.954636 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-468c6ddf-acb5-4afa-9c54-ec76750d6946 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:43.961495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-468c6ddf-acb5-4afa-9c54-ec76750d6946 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:43.961495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-468c6ddf-acb5-4afa-9c54-ec76750d6946 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:44.166181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-468c6ddf-acb5-4afa-9c54-ec76750d6946 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:44.178212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-468c6ddf-acb5-4afa-9c54-ec76750d6946 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:44.180142 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-468c6ddf-acb5-4afa-9c54-ec76750d6946 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:44.181758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-468c6ddf-acb5-4afa-9c54-ec76750d6946 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.240262 Apr 12 14:56:44.182323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 179/361] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:43 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:44.510013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d2ce08af-53bf-46d3-9489-1c5e6879d7e4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:44.511703 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d2ce08af-53bf-46d3-9489-1c5e6879d7e4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:44.526942 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d2ce08af-53bf-46d3-9489-1c5e6879d7e4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:44.528014 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d2ce08af-53bf-46d3-9489-1c5e6879d7e4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:44.529117 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d2ce08af-53bf-46d3-9489-1c5e6879d7e4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:44.529847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d2ce08af-53bf-46d3-9489-1c5e6879d7e4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:44.713707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d2ce08af-53bf-46d3-9489-1c5e6879d7e4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:44.724416 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d2ce08af-53bf-46d3-9489-1c5e6879d7e4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.219860 Apr 12 14:56:44.725104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 183/362] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:44 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:44.819653 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-610552c3-29ff-4945-8246-20693ada215f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:44.820422 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-610552c3-29ff-4945-8246-20693ada215f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:44.831878 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-610552c3-29ff-4945-8246-20693ada215f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:44.833199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-610552c3-29ff-4945-8246-20693ada215f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:44.834057 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-610552c3-29ff-4945-8246-20693ada215f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:44.834667 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-610552c3-29ff-4945-8246-20693ada215f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:44.905587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a3ef96ec-a3b5-4744-8084-9a53b108687c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:44.911287 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a3ef96ec-a3b5-4744-8084-9a53b108687c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:44.986752 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a3ef96ec-a3b5-4744-8084-9a53b108687c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:44.997787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a3ef96ec-a3b5-4744-8084-9a53b108687c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1243 microversion: 2.1 time: 0.096755 Apr 12 14:56:44.998549 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 184/363] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:44 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1243 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:45.010468 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-610552c3-29ff-4945-8246-20693ada215f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:45.020001 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-610552c3-29ff-4945-8246-20693ada215f tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.204225 Apr 12 14:56:45.021568 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 180/364] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:44 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:45.215193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dd046666-1cae-427b-8e82-c6b6f5be9fa2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:45.215193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dd046666-1cae-427b-8e82-c6b6f5be9fa2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:45.216415 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd046666-1cae-427b-8e82-c6b6f5be9fa2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:45.217078 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd046666-1cae-427b-8e82-c6b6f5be9fa2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:45.218361 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd046666-1cae-427b-8e82-c6b6f5be9fa2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:45.219181 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd046666-1cae-427b-8e82-c6b6f5be9fa2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:45.418607 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd046666-1cae-427b-8e82-c6b6f5be9fa2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:45.427276 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd046666-1cae-427b-8e82-c6b6f5be9fa2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:45.428905 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd046666-1cae-427b-8e82-c6b6f5be9fa2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:45.430687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dd046666-1cae-427b-8e82-c6b6f5be9fa2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.233261 Apr 12 14:56:45.441168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 185/365] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:45 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:45.753393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fc606d48-61d5-4323-8a5d-86b50259b00b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:45.754554 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fc606d48-61d5-4323-8a5d-86b50259b00b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:45.762867 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc606d48-61d5-4323-8a5d-86b50259b00b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:45.763255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc606d48-61d5-4323-8a5d-86b50259b00b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:45.764043 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc606d48-61d5-4323-8a5d-86b50259b00b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:45.764477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc606d48-61d5-4323-8a5d-86b50259b00b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:45.915230 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fc606d48-61d5-4323-8a5d-86b50259b00b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:45.925216 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fc606d48-61d5-4323-8a5d-86b50259b00b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.185226 Apr 12 14:56:45.926280 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 181/366] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:45 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:46.015268 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-777b99a3-df27-4d63-952a-036914d5eab4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:46.015921 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-777b99a3-df27-4d63-952a-036914d5eab4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:46.022736 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-777b99a3-df27-4d63-952a-036914d5eab4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:46.023192 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-777b99a3-df27-4d63-952a-036914d5eab4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:46.023984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-777b99a3-df27-4d63-952a-036914d5eab4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:46.024415 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-777b99a3-df27-4d63-952a-036914d5eab4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:46.038391 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a8529dc7-6481-405d-b746-073e39ec8efa tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:46.039030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a8529dc7-6481-405d-b746-073e39ec8efa tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:46.046323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a8529dc7-6481-405d-b746-073e39ec8efa tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:46.049068 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a8529dc7-6481-405d-b746-073e39ec8efa tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:46.049068 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a8529dc7-6481-405d-b746-073e39ec8efa tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:46.049068 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a8529dc7-6481-405d-b746-073e39ec8efa tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:46.101324 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-777b99a3-df27-4d63-952a-036914d5eab4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:46.108972 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-777b99a3-df27-4d63-952a-036914d5eab4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1247 microversion: 2.1 time: 0.097807 Apr 12 14:56:46.109548 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 186/367] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:46 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:46.197855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a8529dc7-6481-405d-b746-073e39ec8efa tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:46.206903 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a8529dc7-6481-405d-b746-073e39ec8efa tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.172389 Apr 12 14:56:46.207763 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 182/368] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:46 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:46.448842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-37d4f9e5-e9f4-4317-b42c-1ea507165934 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:46.449450 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-37d4f9e5-e9f4-4317-b42c-1ea507165934 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:46.457331 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37d4f9e5-e9f4-4317-b42c-1ea507165934 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:46.457819 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37d4f9e5-e9f4-4317-b42c-1ea507165934 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:46.458601 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37d4f9e5-e9f4-4317-b42c-1ea507165934 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:46.459040 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37d4f9e5-e9f4-4317-b42c-1ea507165934 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:46.625069 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-37d4f9e5-e9f4-4317-b42c-1ea507165934 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:46.633274 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-37d4f9e5-e9f4-4317-b42c-1ea507165934 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:46.634919 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-37d4f9e5-e9f4-4317-b42c-1ea507165934 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:46.636088 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-37d4f9e5-e9f4-4317-b42c-1ea507165934 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.191655 Apr 12 14:56:46.636838 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 187/369] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:46 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:46.945885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bcc59231-9562-4b09-8197-6e143243fcc9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:46.947914 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bcc59231-9562-4b09-8197-6e143243fcc9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:46.954979 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcc59231-9562-4b09-8197-6e143243fcc9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:46.955717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcc59231-9562-4b09-8197-6e143243fcc9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:46.956492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcc59231-9562-4b09-8197-6e143243fcc9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:46.957120 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcc59231-9562-4b09-8197-6e143243fcc9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:47.111988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bcc59231-9562-4b09-8197-6e143243fcc9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:47.126234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-824e4dd9-b7e2-48ec-8ca1-f96ca3c9397c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:47.127601 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-824e4dd9-b7e2-48ec-8ca1-f96ca3c9397c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:47.133526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bcc59231-9562-4b09-8197-6e143243fcc9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.192171 Apr 12 14:56:47.136917 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-824e4dd9-b7e2-48ec-8ca1-f96ca3c9397c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:47.138004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-824e4dd9-b7e2-48ec-8ca1-f96ca3c9397c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:47.139050 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-824e4dd9-b7e2-48ec-8ca1-f96ca3c9397c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:47.139931 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-824e4dd9-b7e2-48ec-8ca1-f96ca3c9397c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:47.145799 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 183/370] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:46 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:47.209936 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-824e4dd9-b7e2-48ec-8ca1-f96ca3c9397c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:47.220940 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-824e4dd9-b7e2-48ec-8ca1-f96ca3c9397c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1247 microversion: 2.1 time: 0.098011 Apr 12 14:56:47.224666 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-23c91ccd-e1d7-4d74-8f64-b35a55cb2329 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:47.226202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-23c91ccd-e1d7-4d74-8f64-b35a55cb2329 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:47.238455 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-23c91ccd-e1d7-4d74-8f64-b35a55cb2329 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:47.238694 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 188/371] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:47 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1247 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:47.239130 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-23c91ccd-e1d7-4d74-8f64-b35a55cb2329 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:47.239985 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-23c91ccd-e1d7-4d74-8f64-b35a55cb2329 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:47.240490 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-23c91ccd-e1d7-4d74-8f64-b35a55cb2329 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:47.401767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-23c91ccd-e1d7-4d74-8f64-b35a55cb2329 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:47.410173 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-23c91ccd-e1d7-4d74-8f64-b35a55cb2329 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.189503 Apr 12 14:56:47.414000 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 184/372] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:47 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:47.659384 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-620c16e0-dcec-45ba-9420-26ccf0fb8a5c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:47.663738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-620c16e0-dcec-45ba-9420-26ccf0fb8a5c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:47.675562 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-620c16e0-dcec-45ba-9420-26ccf0fb8a5c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:47.676272 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-620c16e0-dcec-45ba-9420-26ccf0fb8a5c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:47.678137 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-620c16e0-dcec-45ba-9420-26ccf0fb8a5c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:47.678827 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-620c16e0-dcec-45ba-9420-26ccf0fb8a5c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:47.868783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-620c16e0-dcec-45ba-9420-26ccf0fb8a5c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:47.878292 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-620c16e0-dcec-45ba-9420-26ccf0fb8a5c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:47.885024 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-620c16e0-dcec-45ba-9420-26ccf0fb8a5c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:47.888320 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-620c16e0-dcec-45ba-9420-26ccf0fb8a5c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.235005 Apr 12 14:56:47.889106 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 189/373] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:47 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:48.152896 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-61ee4f7d-2b2e-492c-9e1b-dbf02a20db9d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:48.153438 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-61ee4f7d-2b2e-492c-9e1b-dbf02a20db9d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:48.167556 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-61ee4f7d-2b2e-492c-9e1b-dbf02a20db9d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:48.167929 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-61ee4f7d-2b2e-492c-9e1b-dbf02a20db9d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:48.168827 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-61ee4f7d-2b2e-492c-9e1b-dbf02a20db9d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:48.169354 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-61ee4f7d-2b2e-492c-9e1b-dbf02a20db9d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:48.239914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2fd39fc7-6016-4fb8-a987-c1023cd575c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:48.240622 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2fd39fc7-6016-4fb8-a987-c1023cd575c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:48.254586 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2fd39fc7-6016-4fb8-a987-c1023cd575c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:48.255122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2fd39fc7-6016-4fb8-a987-c1023cd575c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:48.255998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2fd39fc7-6016-4fb8-a987-c1023cd575c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:48.259065 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2fd39fc7-6016-4fb8-a987-c1023cd575c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:48.361880 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-61ee4f7d-2b2e-492c-9e1b-dbf02a20db9d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:48.381418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2fd39fc7-6016-4fb8-a987-c1023cd575c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:48.390017 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2fd39fc7-6016-4fb8-a987-c1023cd575c9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1247 microversion: 2.1 time: 0.154909 Apr 12 14:56:48.391425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-61ee4f7d-2b2e-492c-9e1b-dbf02a20db9d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.234709 Apr 12 14:56:48.400778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 185/374] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:48 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:48.402462 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 190/375] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:48 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1247 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:48.428555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f8da4ea5-2332-4787-8aa3-5ba5bc8dfdc0 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:48.429065 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f8da4ea5-2332-4787-8aa3-5ba5bc8dfdc0 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:48.435719 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f8da4ea5-2332-4787-8aa3-5ba5bc8dfdc0 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:48.436308 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f8da4ea5-2332-4787-8aa3-5ba5bc8dfdc0 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:48.437087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f8da4ea5-2332-4787-8aa3-5ba5bc8dfdc0 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:48.437518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f8da4ea5-2332-4787-8aa3-5ba5bc8dfdc0 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:48.617396 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f8da4ea5-2332-4787-8aa3-5ba5bc8dfdc0 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:48.628888 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f8da4ea5-2332-4787-8aa3-5ba5bc8dfdc0 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.201863 Apr 12 14:56:48.641201 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 186/376] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:48 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:48.907225 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bcaec6c3-0cd9-4ae3-8ba9-c6b7a4f86af7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:48.907978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bcaec6c3-0cd9-4ae3-8ba9-c6b7a4f86af7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:48.914560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bcaec6c3-0cd9-4ae3-8ba9-c6b7a4f86af7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:48.915124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bcaec6c3-0cd9-4ae3-8ba9-c6b7a4f86af7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:48.916929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bcaec6c3-0cd9-4ae3-8ba9-c6b7a4f86af7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:48.917435 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bcaec6c3-0cd9-4ae3-8ba9-c6b7a4f86af7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:49.054353 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bcaec6c3-0cd9-4ae3-8ba9-c6b7a4f86af7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:49.062734 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bcaec6c3-0cd9-4ae3-8ba9-c6b7a4f86af7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:49.064234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bcaec6c3-0cd9-4ae3-8ba9-c6b7a4f86af7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:49.065385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bcaec6c3-0cd9-4ae3-8ba9-c6b7a4f86af7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.162176 Apr 12 14:56:49.065978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 191/377] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:48 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:49.408581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-71eddba0-c234-4562-933e-4a01842c5167 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:49.409151 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-71eddba0-c234-4562-933e-4a01842c5167 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:49.409838 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3af783a9-e822-451d-af53-9387884f4e49 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:49.410463 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3af783a9-e822-451d-af53-9387884f4e49 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:49.416833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71eddba0-c234-4562-933e-4a01842c5167 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:49.417285 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71eddba0-c234-4562-933e-4a01842c5167 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:49.417459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3af783a9-e822-451d-af53-9387884f4e49 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:49.417996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3af783a9-e822-451d-af53-9387884f4e49 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:49.418121 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71eddba0-c234-4562-933e-4a01842c5167 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:49.418843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71eddba0-c234-4562-933e-4a01842c5167 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:49.418980 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3af783a9-e822-451d-af53-9387884f4e49 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:49.419252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3af783a9-e822-451d-af53-9387884f4e49 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:49.505902 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3af783a9-e822-451d-af53-9387884f4e49 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:49.515996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3af783a9-e822-451d-af53-9387884f4e49 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1247 microversion: 2.1 time: 0.111399 Apr 12 14:56:49.516583 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 192/378] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:49 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1247 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:49.583009 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-71eddba0-c234-4562-933e-4a01842c5167 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:49.591353 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-71eddba0-c234-4562-933e-4a01842c5167 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.186807 Apr 12 14:56:49.591905 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 187/379] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:49 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:49.645970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-55d4a05b-ff4b-48aa-8892-4306641ad430 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:49.646570 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-55d4a05b-ff4b-48aa-8892-4306641ad430 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:49.653435 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-55d4a05b-ff4b-48aa-8892-4306641ad430 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:49.653896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-55d4a05b-ff4b-48aa-8892-4306641ad430 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:49.655206 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-55d4a05b-ff4b-48aa-8892-4306641ad430 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:49.655206 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-55d4a05b-ff4b-48aa-8892-4306641ad430 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:49.823098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-55d4a05b-ff4b-48aa-8892-4306641ad430 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:49.838643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-55d4a05b-ff4b-48aa-8892-4306641ad430 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.196351 Apr 12 14:56:49.853350 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 193/380] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:49 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:50.085216 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-97822968-d413-465e-adb8-8c6b586432bd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:50.086016 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-97822968-d413-465e-adb8-8c6b586432bd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:50.096813 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-97822968-d413-465e-adb8-8c6b586432bd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:50.097550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-97822968-d413-465e-adb8-8c6b586432bd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:50.098719 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-97822968-d413-465e-adb8-8c6b586432bd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:50.099428 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-97822968-d413-465e-adb8-8c6b586432bd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:50.310145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-97822968-d413-465e-adb8-8c6b586432bd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:50.326112 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-97822968-d413-465e-adb8-8c6b586432bd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:50.329460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-97822968-d413-465e-adb8-8c6b586432bd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:50.330708 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-97822968-d413-465e-adb8-8c6b586432bd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.249734 Apr 12 14:56:50.331273 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 188/381] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:50 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:50.537589 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-71397a16-3e0b-47d9-a7c4-d5bc344ec087 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:50.544357 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-71397a16-3e0b-47d9-a7c4-d5bc344ec087 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:50.555871 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-71397a16-3e0b-47d9-a7c4-d5bc344ec087 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:50.556608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-71397a16-3e0b-47d9-a7c4-d5bc344ec087 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:50.557561 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-71397a16-3e0b-47d9-a7c4-d5bc344ec087 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:50.558222 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-71397a16-3e0b-47d9-a7c4-d5bc344ec087 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:50.609451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a4b60d7c-7c32-427e-b2b8-341ee9e16f3e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:50.610339 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a4b60d7c-7c32-427e-b2b8-341ee9e16f3e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:50.622904 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4b60d7c-7c32-427e-b2b8-341ee9e16f3e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:50.624255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4b60d7c-7c32-427e-b2b8-341ee9e16f3e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:50.625430 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4b60d7c-7c32-427e-b2b8-341ee9e16f3e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:50.626245 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4b60d7c-7c32-427e-b2b8-341ee9e16f3e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:50.694836 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-71397a16-3e0b-47d9-a7c4-d5bc344ec087 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:50.705965 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-71397a16-3e0b-47d9-a7c4-d5bc344ec087 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1295 microversion: 2.1 time: 0.175237 Apr 12 14:56:50.719047 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 194/382] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:50 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1295 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:50.736580 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-48ff0f27-238c-44eb-8b7f-2b5d61f398e6 req-eb5ca667-fb7e-4e5f-b48f-fff73c446d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a709c0e8-54c5-43a2-a065-4ee9445449c9", "name": "network-vif-plugged", "status": "completed", "tag": "d3c74b15-1916-4ae7-bef5-d2dee4e37164"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:50.793707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-48ff0f27-238c-44eb-8b7f-2b5d61f398e6 req-eb5ca667-fb7e-4e5f-b48f-fff73c446d40 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:50.794700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-48ff0f27-238c-44eb-8b7f-2b5d61f398e6 req-eb5ca667-fb7e-4e5f-b48f-fff73c446d40 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:50.841006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-48ff0f27-238c-44eb-8b7f-2b5d61f398e6 req-eb5ca667-fb7e-4e5f-b48f-fff73c446d40 service nova] Creating event network-vif-plugged:d3c74b15-1916-4ae7-bef5-d2dee4e37164 for instance a709c0e8-54c5-43a2-a065-4ee9445449c9 on hv-cinder-83752 Apr 12 14:56:50.867106 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-48ff0f27-238c-44eb-8b7f-2b5d61f398e6 req-eb5ca667-fb7e-4e5f-b48f-fff73c446d40 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143690 Apr 12 14:56:50.867821 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 195/383] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:56:50.877053 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2c6e5e06-7b66-4a1f-a9ec-f4195aa9a16d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:50.877053 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2c6e5e06-7b66-4a1f-a9ec-f4195aa9a16d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:50.891998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c6e5e06-7b66-4a1f-a9ec-f4195aa9a16d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:50.896667 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c6e5e06-7b66-4a1f-a9ec-f4195aa9a16d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:50.896667 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c6e5e06-7b66-4a1f-a9ec-f4195aa9a16d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:50.896667 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c6e5e06-7b66-4a1f-a9ec-f4195aa9a16d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:50.974020 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a4b60d7c-7c32-427e-b2b8-341ee9e16f3e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:51.008769 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a4b60d7c-7c32-427e-b2b8-341ee9e16f3e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.404275 Apr 12 14:56:51.026248 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 189/384] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:50 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:51.204282 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2c6e5e06-7b66-4a1f-a9ec-f4195aa9a16d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:51.218573 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2c6e5e06-7b66-4a1f-a9ec-f4195aa9a16d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.347668 Apr 12 14:56:51.228628 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 196/385] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:50 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:51.349673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-44656b4c-f25c-406d-ba72-4e41871c39c9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:51.351138 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-44656b4c-f25c-406d-ba72-4e41871c39c9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:51.362251 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44656b4c-f25c-406d-ba72-4e41871c39c9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:51.362851 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44656b4c-f25c-406d-ba72-4e41871c39c9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:51.367248 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44656b4c-f25c-406d-ba72-4e41871c39c9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:51.367248 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-44656b4c-f25c-406d-ba72-4e41871c39c9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:51.562806 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-44656b4c-f25c-406d-ba72-4e41871c39c9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:51.574757 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-44656b4c-f25c-406d-ba72-4e41871c39c9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:51.578478 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-44656b4c-f25c-406d-ba72-4e41871c39c9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:51.579590 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-44656b4c-f25c-406d-ba72-4e41871c39c9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.233943 Apr 12 14:56:51.580689 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 190/386] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:51 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:51.728260 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-75df2328-1f58-41dd-a8dd-4da670c5fd03 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:51.729852 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-75df2328-1f58-41dd-a8dd-4da670c5fd03 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:51.742483 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75df2328-1f58-41dd-a8dd-4da670c5fd03 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:51.743073 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75df2328-1f58-41dd-a8dd-4da670c5fd03 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:51.744995 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75df2328-1f58-41dd-a8dd-4da670c5fd03 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:51.745429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75df2328-1f58-41dd-a8dd-4da670c5fd03 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:51.859943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-75df2328-1f58-41dd-a8dd-4da670c5fd03 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:51.870058 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-75df2328-1f58-41dd-a8dd-4da670c5fd03 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1301 microversion: 2.1 time: 0.146035 Apr 12 14:56:51.871037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 197/387] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:51 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1301 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:52.034251 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b15977f9-aaac-48f6-9952-16c97bf08a48 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:52.039153 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b15977f9-aaac-48f6-9952-16c97bf08a48 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:52.058802 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b15977f9-aaac-48f6-9952-16c97bf08a48 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:52.059691 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b15977f9-aaac-48f6-9952-16c97bf08a48 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:52.060754 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b15977f9-aaac-48f6-9952-16c97bf08a48 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:52.061400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b15977f9-aaac-48f6-9952-16c97bf08a48 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:52.248647 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c02b6813-73e4-4f0a-b73c-b4a2784b2f0d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:52.249993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c02b6813-73e4-4f0a-b73c-b4a2784b2f0d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:52.258739 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c02b6813-73e4-4f0a-b73c-b4a2784b2f0d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:52.260576 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c02b6813-73e4-4f0a-b73c-b4a2784b2f0d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:52.261602 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c02b6813-73e4-4f0a-b73c-b4a2784b2f0d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:52.262222 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c02b6813-73e4-4f0a-b73c-b4a2784b2f0d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:52.302448 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b15977f9-aaac-48f6-9952-16c97bf08a48 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:52.314303 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b15977f9-aaac-48f6-9952-16c97bf08a48 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.285421 Apr 12 14:56:52.317370 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 191/388] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:52 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:52.458599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c02b6813-73e4-4f0a-b73c-b4a2784b2f0d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:52.470110 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c02b6813-73e4-4f0a-b73c-b4a2784b2f0d tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.228072 Apr 12 14:56:52.480077 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 198/389] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:52 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:52.600987 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-76529eab-dd1a-43e0-ac30-95e166c1a9e5 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:52.603707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-76529eab-dd1a-43e0-ac30-95e166c1a9e5 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:52.612291 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76529eab-dd1a-43e0-ac30-95e166c1a9e5 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:52.613683 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76529eab-dd1a-43e0-ac30-95e166c1a9e5 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:52.614935 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76529eab-dd1a-43e0-ac30-95e166c1a9e5 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:52.615656 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76529eab-dd1a-43e0-ac30-95e166c1a9e5 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:52.850476 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-76529eab-dd1a-43e0-ac30-95e166c1a9e5 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:52.867486 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-76529eab-dd1a-43e0-ac30-95e166c1a9e5 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:52.877618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-76529eab-dd1a-43e0-ac30-95e166c1a9e5 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:52.882092 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-76529eab-dd1a-43e0-ac30-95e166c1a9e5 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.283490 Apr 12 14:56:52.882873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 192/390] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:52 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:52.893072 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8ddb04fd-2eaf-4296-8bb8-0b3358b1c500 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:52.894314 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8ddb04fd-2eaf-4296-8bb8-0b3358b1c500 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:52.910703 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ddb04fd-2eaf-4296-8bb8-0b3358b1c500 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:52.911416 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ddb04fd-2eaf-4296-8bb8-0b3358b1c500 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:52.912420 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ddb04fd-2eaf-4296-8bb8-0b3358b1c500 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:52.913035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ddb04fd-2eaf-4296-8bb8-0b3358b1c500 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:52.927819 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-9f6d49e9-8bb6-4f54-83cd-ccd630f82be1 req-bb4e0a0c-63e0-4eea-8d6a-41d5dbb3e1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d269e33-8e2d-4352-ba0f-c6d1470ca3fe", "name": "network-vif-plugged", "status": "completed", "tag": "673fcf47-27a7-4822-bdb5-6b9a776150bc"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:52.939971 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-9f6d49e9-8bb6-4f54-83cd-ccd630f82be1 req-bb4e0a0c-63e0-4eea-8d6a-41d5dbb3e1fd service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:52.940349 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-9f6d49e9-8bb6-4f54-83cd-ccd630f82be1 req-bb4e0a0c-63e0-4eea-8d6a-41d5dbb3e1fd service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:52.971803 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-9f6d49e9-8bb6-4f54-83cd-ccd630f82be1 req-bb4e0a0c-63e0-4eea-8d6a-41d5dbb3e1fd service nova] Creating event network-vif-plugged:673fcf47-27a7-4822-bdb5-6b9a776150bc for instance 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe on hv-cinder-83752 Apr 12 14:56:52.978779 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-9f6d49e9-8bb6-4f54-83cd-ccd630f82be1 req-bb4e0a0c-63e0-4eea-8d6a-41d5dbb3e1fd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054248 Apr 12 14:56:52.980193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 193/391] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:56:53.130682 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8ddb04fd-2eaf-4296-8bb8-0b3358b1c500 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:53.143470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8ddb04fd-2eaf-4296-8bb8-0b3358b1c500 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.253312 Apr 12 14:56:53.144311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 199/392] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:52 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:53.335135 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-049137b6-234c-4e1d-8418-e682a8cc8c9f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:53.336665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-049137b6-234c-4e1d-8418-e682a8cc8c9f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:53.345974 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-049137b6-234c-4e1d-8418-e682a8cc8c9f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:53.347484 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-049137b6-234c-4e1d-8418-e682a8cc8c9f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:53.349312 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-049137b6-234c-4e1d-8418-e682a8cc8c9f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:53.350458 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-049137b6-234c-4e1d-8418-e682a8cc8c9f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:53.489378 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e89bc1cd-c5cf-44bb-9684-570d1f152354 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:53.490024 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e89bc1cd-c5cf-44bb-9684-570d1f152354 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:53.497278 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e89bc1cd-c5cf-44bb-9684-570d1f152354 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:53.497765 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e89bc1cd-c5cf-44bb-9684-570d1f152354 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:53.498585 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e89bc1cd-c5cf-44bb-9684-570d1f152354 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:53.499027 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e89bc1cd-c5cf-44bb-9684-570d1f152354 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:53.512195 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-049137b6-234c-4e1d-8418-e682a8cc8c9f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:53.520166 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-049137b6-234c-4e1d-8418-e682a8cc8c9f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1366 microversion: 2.1 time: 0.189153 Apr 12 14:56:53.520859 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 194/393] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:53 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:53.647468 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e89bc1cd-c5cf-44bb-9684-570d1f152354 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:53.655675 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e89bc1cd-c5cf-44bb-9684-570d1f152354 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.171217 Apr 12 14:56:53.656254 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 200/394] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:53 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:53.906663 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3703253d-1d01-4185-a873-65e92d6efa72 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:53.907182 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3703253d-1d01-4185-a873-65e92d6efa72 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:53.913148 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3703253d-1d01-4185-a873-65e92d6efa72 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:53.913587 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3703253d-1d01-4185-a873-65e92d6efa72 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:53.914376 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3703253d-1d01-4185-a873-65e92d6efa72 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:53.914797 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3703253d-1d01-4185-a873-65e92d6efa72 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:54.067760 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3703253d-1d01-4185-a873-65e92d6efa72 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:54.075668 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3703253d-1d01-4185-a873-65e92d6efa72 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:54.077446 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3703253d-1d01-4185-a873-65e92d6efa72 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:54.078618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3703253d-1d01-4185-a873-65e92d6efa72 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.179459 Apr 12 14:56:54.081587 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 195/395] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:53 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:54.160872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-02fba806-281f-4d9b-b241-aeb1c9f4ce37 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:54.161655 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-02fba806-281f-4d9b-b241-aeb1c9f4ce37 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:54.172216 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-02fba806-281f-4d9b-b241-aeb1c9f4ce37 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:54.172669 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-02fba806-281f-4d9b-b241-aeb1c9f4ce37 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:54.173461 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-02fba806-281f-4d9b-b241-aeb1c9f4ce37 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:54.173926 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-02fba806-281f-4d9b-b241-aeb1c9f4ce37 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:54.315619 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-02fba806-281f-4d9b-b241-aeb1c9f4ce37 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:54.333417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-02fba806-281f-4d9b-b241-aeb1c9f4ce37 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.174454 Apr 12 14:56:54.334163 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 201/396] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:54 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:54.538660 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-17e5250b-9832-45fe-af46-c4730c586607 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:54.541616 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-17e5250b-9832-45fe-af46-c4730c586607 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:54.560667 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-17e5250b-9832-45fe-af46-c4730c586607 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:54.561236 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-17e5250b-9832-45fe-af46-c4730c586607 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:54.562093 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-17e5250b-9832-45fe-af46-c4730c586607 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:54.570584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-17e5250b-9832-45fe-af46-c4730c586607 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:54.674725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3023393a-a4c5-47dc-9c8a-dd8e11cb38db tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:54.677562 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3023393a-a4c5-47dc-9c8a-dd8e11cb38db tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:54.686687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3023393a-a4c5-47dc-9c8a-dd8e11cb38db tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:54.687361 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3023393a-a4c5-47dc-9c8a-dd8e11cb38db tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:54.688514 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3023393a-a4c5-47dc-9c8a-dd8e11cb38db tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:54.689197 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3023393a-a4c5-47dc-9c8a-dd8e11cb38db tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:54.834003 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-17e5250b-9832-45fe-af46-c4730c586607 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:54.843630 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-17e5250b-9832-45fe-af46-c4730c586607 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1556 microversion: 2.1 time: 0.308891 Apr 12 14:56:54.847499 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 196/397] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:54 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1556 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:54.864615 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b4dd3611-d9b2-4a17-9063-c65946972c5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:54.870956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b4dd3611-d9b2-4a17-9063-c65946972c5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:54.880990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4dd3611-d9b2-4a17-9063-c65946972c5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:54.880990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4dd3611-d9b2-4a17-9063-c65946972c5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:54.882316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4dd3611-d9b2-4a17-9063-c65946972c5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:54.885590 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4dd3611-d9b2-4a17-9063-c65946972c5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:54.995436 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3023393a-a4c5-47dc-9c8a-dd8e11cb38db tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:55.003907 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3023393a-a4c5-47dc-9c8a-dd8e11cb38db tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.334766 Apr 12 14:56:55.011298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 202/398] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:54 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:55.016271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-2cc608f1-9505-4af8-acb2-d446527c36ab req-ac4e4d12-5898-4d9e-a370-d1179e40d598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd692aa-e03c-4686-8512-e5b6d426893f", "tag": "d0d6b7ba-aadc-4c5d-96b6-feb347509ccf"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:55.025079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b4dd3611-d9b2-4a17-9063-c65946972c5f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163798 Apr 12 14:56:55.027335 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 197/399] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Apr 12 14:56:54 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:56:55.049160 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-2cc608f1-9505-4af8-acb2-d446527c36ab req-ac4e4d12-5898-4d9e-a370-d1179e40d598 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:55.049440 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-2cc608f1-9505-4af8-acb2-d446527c36ab req-ac4e4d12-5898-4d9e-a370-d1179e40d598 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:55.062609 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-2cc608f1-9505-4af8-acb2-d446527c36ab req-ac4e4d12-5898-4d9e-a370-d1179e40d598 service nova] Creating event network-changed:d0d6b7ba-aadc-4c5d-96b6-feb347509ccf for instance dfd692aa-e03c-4686-8512-e5b6d426893f on hv-cinder-83752 Apr 12 14:56:55.069129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-2cc608f1-9505-4af8-acb2-d446527c36ab req-ac4e4d12-5898-4d9e-a370-d1179e40d598 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056438 Apr 12 14:56:55.070236 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 203/400] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:56:55.097791 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7b8307f2-3b93-4de3-81ee-9828146052e7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:55.098408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7b8307f2-3b93-4de3-81ee-9828146052e7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:55.108827 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7b8307f2-3b93-4de3-81ee-9828146052e7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:55.111108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7b8307f2-3b93-4de3-81ee-9828146052e7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:55.111957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7b8307f2-3b93-4de3-81ee-9828146052e7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:55.112403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7b8307f2-3b93-4de3-81ee-9828146052e7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:55.305211 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7b8307f2-3b93-4de3-81ee-9828146052e7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:55.316556 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7b8307f2-3b93-4de3-81ee-9828146052e7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:55.318441 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7b8307f2-3b93-4de3-81ee-9828146052e7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:55.319598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7b8307f2-3b93-4de3-81ee-9828146052e7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.225815 Apr 12 14:56:55.320158 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 198/401] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:55 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:55.351547 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ca8325f0-6a7e-4ac1-8488-ed6a3f9d998e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:55.352275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ca8325f0-6a7e-4ac1-8488-ed6a3f9d998e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:55.359825 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca8325f0-6a7e-4ac1-8488-ed6a3f9d998e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:55.360276 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca8325f0-6a7e-4ac1-8488-ed6a3f9d998e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:55.361077 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca8325f0-6a7e-4ac1-8488-ed6a3f9d998e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:55.361528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca8325f0-6a7e-4ac1-8488-ed6a3f9d998e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:55.505810 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ca8325f0-6a7e-4ac1-8488-ed6a3f9d998e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:55.513619 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ca8325f0-6a7e-4ac1-8488-ed6a3f9d998e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.166619 Apr 12 14:56:55.519012 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 204/402] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:55 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:56.021350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ad073f05-5fd6-4ac7-9e56-c5106c5991f7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:56.022019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ad073f05-5fd6-4ac7-9e56-c5106c5991f7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:56.029337 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad073f05-5fd6-4ac7-9e56-c5106c5991f7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:56.029943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad073f05-5fd6-4ac7-9e56-c5106c5991f7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:56.030642 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad073f05-5fd6-4ac7-9e56-c5106c5991f7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:56.031077 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad073f05-5fd6-4ac7-9e56-c5106c5991f7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:56.167578 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ad073f05-5fd6-4ac7-9e56-c5106c5991f7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:56.175173 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ad073f05-5fd6-4ac7-9e56-c5106c5991f7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1314 microversion: 2.1 time: 0.157668 Apr 12 14:56:56.175749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 199/403] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:56 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:56.342889 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-03947efd-2365-4c22-b4e0-0e17c5a2b0af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:56.344220 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-03947efd-2365-4c22-b4e0-0e17c5a2b0af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:56.351530 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03947efd-2365-4c22-b4e0-0e17c5a2b0af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:56.352165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03947efd-2365-4c22-b4e0-0e17c5a2b0af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:56.353299 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03947efd-2365-4c22-b4e0-0e17c5a2b0af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:56.354106 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03947efd-2365-4c22-b4e0-0e17c5a2b0af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:56.529281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-03947efd-2365-4c22-b4e0-0e17c5a2b0af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:56.535748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5da3bf4e-0352-4765-b46a-5bc3242cf75e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:56.536598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5da3bf4e-0352-4765-b46a-5bc3242cf75e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:56.539856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-03947efd-2365-4c22-b4e0-0e17c5a2b0af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:56.543082 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5da3bf4e-0352-4765-b46a-5bc3242cf75e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:56.543811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5da3bf4e-0352-4765-b46a-5bc3242cf75e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:56.543946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-03947efd-2365-4c22-b4e0-0e17c5a2b0af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:56.544951 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5da3bf4e-0352-4765-b46a-5bc3242cf75e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:56.545301 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-03947efd-2365-4c22-b4e0-0e17c5a2b0af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.210569 Apr 12 14:56:56.545850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5da3bf4e-0352-4765-b46a-5bc3242cf75e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:56.546039 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 205/404] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:56 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:56:56.698929 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5da3bf4e-0352-4765-b46a-5bc3242cf75e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:56.706998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5da3bf4e-0352-4765-b46a-5bc3242cf75e tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.176399 Apr 12 14:56:56.708198 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 200/405] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:56 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:57.107166 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-fd6c2303-85a8-44ba-9f8a-e7cef3920343 req-3bb2aa13-8f73-4e5e-9bc0-cef103b1b080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a709c0e8-54c5-43a2-a065-4ee9445449c9", "tag": "d3c74b15-1916-4ae7-bef5-d2dee4e37164"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:56:57.115286 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-fd6c2303-85a8-44ba-9f8a-e7cef3920343 req-3bb2aa13-8f73-4e5e-9bc0-cef103b1b080 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.115769 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-fd6c2303-85a8-44ba-9f8a-e7cef3920343 req-3bb2aa13-8f73-4e5e-9bc0-cef103b1b080 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.128695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-fd6c2303-85a8-44ba-9f8a-e7cef3920343 req-3bb2aa13-8f73-4e5e-9bc0-cef103b1b080 service nova] Creating event network-changed:d3c74b15-1916-4ae7-bef5-d2dee4e37164 for instance a709c0e8-54c5-43a2-a065-4ee9445449c9 on hv-cinder-83752 Apr 12 14:56:57.134859 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-fd6c2303-85a8-44ba-9f8a-e7cef3920343 req-3bb2aa13-8f73-4e5e-9bc0-cef103b1b080 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031681 Apr 12 14:56:57.135557 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 206/406] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:56:57.192982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-195b39a4-e4da-43ed-b362-50fea1e3a257 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:57.193734 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-195b39a4-e4da-43ed-b362-50fea1e3a257 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:57.200525 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-195b39a4-e4da-43ed-b362-50fea1e3a257 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.200968 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-195b39a4-e4da-43ed-b362-50fea1e3a257 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.201776 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-195b39a4-e4da-43ed-b362-50fea1e3a257 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.202474 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-195b39a4-e4da-43ed-b362-50fea1e3a257 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.345722 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-195b39a4-e4da-43ed-b362-50fea1e3a257 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:57.353377 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-195b39a4-e4da-43ed-b362-50fea1e3a257 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1464 microversion: 2.1 time: 0.164206 Apr 12 14:56:57.354090 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 201/407] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:57 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1464 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:57.410593 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4555c150-afb3-4fe1-ab9a-0b786452bbf8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:57.411266 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4555c150-afb3-4fe1-ab9a-0b786452bbf8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:57.418253 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4555c150-afb3-4fe1-ab9a-0b786452bbf8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.418691 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4555c150-afb3-4fe1-ab9a-0b786452bbf8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.419467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4555c150-afb3-4fe1-ab9a-0b786452bbf8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.419893 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4555c150-afb3-4fe1-ab9a-0b786452bbf8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.449590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4555c150-afb3-4fe1-ab9a-0b786452bbf8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 14:56:57.564680 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-74b571a8-9bf8-49ad-93dc-21e0688467ad tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:57.570331 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-74b571a8-9bf8-49ad-93dc-21e0688467ad tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:57.572690 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-74b571a8-9bf8-49ad-93dc-21e0688467ad tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.572997 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-74b571a8-9bf8-49ad-93dc-21e0688467ad tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.573868 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-74b571a8-9bf8-49ad-93dc-21e0688467ad tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.574305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-74b571a8-9bf8-49ad-93dc-21e0688467ad tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.739704 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-74b571a8-9bf8-49ad-93dc-21e0688467ad tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:57.742825 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-74b571a8-9bf8-49ad-93dc-21e0688467ad tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:57.744901 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-74b571a8-9bf8-49ad-93dc-21e0688467ad tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:57.746280 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-74b571a8-9bf8-49ad-93dc-21e0688467ad tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.185549 Apr 12 14:56:57.746841 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 202/408] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:57 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:56:57.751521 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5a69cf3d-2d99-4e71-a5e1-63799393eab6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:57.752144 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5a69cf3d-2d99-4e71-a5e1-63799393eab6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:57.758303 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5a69cf3d-2d99-4e71-a5e1-63799393eab6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.759429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5a69cf3d-2d99-4e71-a5e1-63799393eab6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.760415 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5a69cf3d-2d99-4e71-a5e1-63799393eab6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.760871 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5a69cf3d-2d99-4e71-a5e1-63799393eab6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.797974 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4555c150-afb3-4fe1-ab9a-0b786452bbf8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 204 len: 0 microversion: 2.1 time: 0.391723 Apr 12 14:56:57.798842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 207/409] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 14:56:57 2022] DELETE /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 14:56:57.808075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6349c399-77e2-40a8-a2c5-84d5b91cb464 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:57.808680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6349c399-77e2-40a8-a2c5-84d5b91cb464 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:57.818016 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6349c399-77e2-40a8-a2c5-84d5b91cb464 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.818470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6349c399-77e2-40a8-a2c5-84d5b91cb464 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.819357 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6349c399-77e2-40a8-a2c5-84d5b91cb464 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:57.819712 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6349c399-77e2-40a8-a2c5-84d5b91cb464 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:57.952536 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5a69cf3d-2d99-4e71-a5e1-63799393eab6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:57.960276 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5a69cf3d-2d99-4e71-a5e1-63799393eab6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.212372 Apr 12 14:56:57.960973 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 203/410] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:57 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:58.010011 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6349c399-77e2-40a8-a2c5-84d5b91cb464 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:58.019694 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6349c399-77e2-40a8-a2c5-84d5b91cb464 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1470 microversion: 2.1 time: 0.216369 Apr 12 14:56:58.020365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 208/411] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:57 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:58.764637 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2b066033-8498-4a6c-b392-528de43738cb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:58.765309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2b066033-8498-4a6c-b392-528de43738cb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:58.772085 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b066033-8498-4a6c-b392-528de43738cb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:58.772518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b066033-8498-4a6c-b392-528de43738cb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:58.773286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b066033-8498-4a6c-b392-528de43738cb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:58.773748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b066033-8498-4a6c-b392-528de43738cb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:58.908659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2b066033-8498-4a6c-b392-528de43738cb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:58.916573 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2b066033-8498-4a6c-b392-528de43738cb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:58.918266 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2b066033-8498-4a6c-b392-528de43738cb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:58.919423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2b066033-8498-4a6c-b392-528de43738cb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1739 microversion: 2.20 time: 0.158969 Apr 12 14:56:58.919981 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 204/412] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:58 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:56:58.979037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4463b12e-9f91-4e25-b01b-1ab715e987c1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:58.979792 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4463b12e-9f91-4e25-b01b-1ab715e987c1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:58.987143 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4463b12e-9f91-4e25-b01b-1ab715e987c1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:58.987638 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4463b12e-9f91-4e25-b01b-1ab715e987c1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:58.988556 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4463b12e-9f91-4e25-b01b-1ab715e987c1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:58.988984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4463b12e-9f91-4e25-b01b-1ab715e987c1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:59.037784 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5579257e-1a9b-49ec-9f9f-cabed590e4b7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:59.038387 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5579257e-1a9b-49ec-9f9f-cabed590e4b7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:59.044630 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5579257e-1a9b-49ec-9f9f-cabed590e4b7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:59.045080 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5579257e-1a9b-49ec-9f9f-cabed590e4b7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:59.045883 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5579257e-1a9b-49ec-9f9f-cabed590e4b7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:59.046315 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5579257e-1a9b-49ec-9f9f-cabed590e4b7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:59.189537 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4463b12e-9f91-4e25-b01b-1ab715e987c1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:59.197804 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4463b12e-9f91-4e25-b01b-1ab715e987c1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.223113 Apr 12 14:56:59.198396 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 209/413] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:58 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:56:59.221641 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5579257e-1a9b-49ec-9f9f-cabed590e4b7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:56:59.229972 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5579257e-1a9b-49ec-9f9f-cabed590e4b7 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1470 microversion: 2.1 time: 0.195936 Apr 12 14:56:59.230611 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 205/414] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:56:59 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:56:59.938067 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b48d2f77-70cd-4cd0-b40c-abb3531f2f7a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:56:59.938698 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b48d2f77-70cd-4cd0-b40c-abb3531f2f7a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:56:59.944696 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b48d2f77-70cd-4cd0-b40c-abb3531f2f7a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:59.945137 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b48d2f77-70cd-4cd0-b40c-abb3531f2f7a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:56:59.945923 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b48d2f77-70cd-4cd0-b40c-abb3531f2f7a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:56:59.947119 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b48d2f77-70cd-4cd0-b40c-abb3531f2f7a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:00.082931 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b48d2f77-70cd-4cd0-b40c-abb3531f2f7a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:00.093770 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b48d2f77-70cd-4cd0-b40c-abb3531f2f7a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:00.095431 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b48d2f77-70cd-4cd0-b40c-abb3531f2f7a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:00.096587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b48d2f77-70cd-4cd0-b40c-abb3531f2f7a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1721 microversion: 2.20 time: 0.162439 Apr 12 14:57:00.097320 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 210/415] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:56:59 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:00.215072 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c1a714a1-f16a-478d-bd14-b91b1e2af26b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:00.215665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c1a714a1-f16a-478d-bd14-b91b1e2af26b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:00.222240 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1a714a1-f16a-478d-bd14-b91b1e2af26b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:00.222683 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1a714a1-f16a-478d-bd14-b91b1e2af26b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:00.223496 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1a714a1-f16a-478d-bd14-b91b1e2af26b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:00.224017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1a714a1-f16a-478d-bd14-b91b1e2af26b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:00.249367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-18b1bd00-a913-415c-9879-96d694cfaafd tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:00.249941 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-18b1bd00-a913-415c-9879-96d694cfaafd tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:00.264242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18b1bd00-a913-415c-9879-96d694cfaafd tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:00.264682 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18b1bd00-a913-415c-9879-96d694cfaafd tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:00.265473 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18b1bd00-a913-415c-9879-96d694cfaafd tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:00.265938 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18b1bd00-a913-415c-9879-96d694cfaafd tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:00.422774 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c1a714a1-f16a-478d-bd14-b91b1e2af26b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:00.430166 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c1a714a1-f16a-478d-bd14-b91b1e2af26b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.219071 Apr 12 14:57:00.437844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 206/416] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:00 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:00.437844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-58d8fb25-1eab-4144-b203-6191f312b63b req-27de247d-4729-4bbf-8be4-887292735b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d03f42e-2d51-459d-ade0-7e6a34283867", "name": "network-vif-unplugged", "status": "completed", "tag": "90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:00.444008 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-58d8fb25-1eab-4144-b203-6191f312b63b req-27de247d-4729-4bbf-8be4-887292735b3e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:00.444446 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-58d8fb25-1eab-4144-b203-6191f312b63b req-27de247d-4729-4bbf-8be4-887292735b3e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:00.456990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-58d8fb25-1eab-4144-b203-6191f312b63b req-27de247d-4729-4bbf-8be4-887292735b3e service nova] Creating event network-vif-unplugged:90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77 for instance 9d03f42e-2d51-459d-ade0-7e6a34283867 on hv-cinder-83752 Apr 12 14:57:00.461773 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-18b1bd00-a913-415c-9879-96d694cfaafd tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:00.466443 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-58d8fb25-1eab-4144-b203-6191f312b63b req-27de247d-4729-4bbf-8be4-887292735b3e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033712 Apr 12 14:57:00.467394 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 207/417] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:00.470008 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-18b1bd00-a913-415c-9879-96d694cfaafd tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1470 microversion: 2.1 time: 0.225880 Apr 12 14:57:00.470824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 211/418] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:00 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:01.116001 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-491fea57-891a-4eb1-b8d0-56cfe42badc0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:01.117144 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-491fea57-891a-4eb1-b8d0-56cfe42badc0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:01.124477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-491fea57-891a-4eb1-b8d0-56cfe42badc0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:01.124988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-491fea57-891a-4eb1-b8d0-56cfe42badc0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:01.125823 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-491fea57-891a-4eb1-b8d0-56cfe42badc0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:01.126296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-491fea57-891a-4eb1-b8d0-56cfe42badc0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:01.271998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-491fea57-891a-4eb1-b8d0-56cfe42badc0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:01.281828 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-491fea57-891a-4eb1-b8d0-56cfe42badc0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:01.283237 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-491fea57-891a-4eb1-b8d0-56cfe42badc0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:01.292034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-491fea57-891a-4eb1-b8d0-56cfe42badc0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1721 microversion: 2.20 time: 0.172745 Apr 12 14:57:01.292034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 208/419] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:01 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:01.448528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7b396c59-8963-4b6d-82fd-55b66d5951fd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:01.449169 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7b396c59-8963-4b6d-82fd-55b66d5951fd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:01.455975 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b396c59-8963-4b6d-82fd-55b66d5951fd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:01.456428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b396c59-8963-4b6d-82fd-55b66d5951fd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:01.457208 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b396c59-8963-4b6d-82fd-55b66d5951fd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:01.457656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b396c59-8963-4b6d-82fd-55b66d5951fd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:01.490325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b33fe9e3-e8cb-4337-bf80-ef32afdbd2e5 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:01.491184 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b33fe9e3-e8cb-4337-bf80-ef32afdbd2e5 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:01.502198 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b33fe9e3-e8cb-4337-bf80-ef32afdbd2e5 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:01.507202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b33fe9e3-e8cb-4337-bf80-ef32afdbd2e5 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:01.507202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b33fe9e3-e8cb-4337-bf80-ef32afdbd2e5 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:01.507202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b33fe9e3-e8cb-4337-bf80-ef32afdbd2e5 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:01.668561 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7b396c59-8963-4b6d-82fd-55b66d5951fd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:01.675988 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7b396c59-8963-4b6d-82fd-55b66d5951fd tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.231329 Apr 12 14:57:01.676682 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 212/420] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:01 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:01.694525 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b33fe9e3-e8cb-4337-bf80-ef32afdbd2e5 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:01.702255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b33fe9e3-e8cb-4337-bf80-ef32afdbd2e5 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1470 microversion: 2.1 time: 0.215486 Apr 12 14:57:01.702827 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 209/421] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:01 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:02.304118 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2f1e3217-2846-4423-97ec-b24cfa8ea677 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:02.305106 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2f1e3217-2846-4423-97ec-b24cfa8ea677 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:02.315914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f1e3217-2846-4423-97ec-b24cfa8ea677 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:02.318994 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f1e3217-2846-4423-97ec-b24cfa8ea677 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:02.318994 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f1e3217-2846-4423-97ec-b24cfa8ea677 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:02.319888 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f1e3217-2846-4423-97ec-b24cfa8ea677 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:02.574984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2f1e3217-2846-4423-97ec-b24cfa8ea677 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:02.590743 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2f1e3217-2846-4423-97ec-b24cfa8ea677 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:02.593145 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2f1e3217-2846-4423-97ec-b24cfa8ea677 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:02.594756 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2f1e3217-2846-4423-97ec-b24cfa8ea677 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1721 microversion: 2.20 time: 0.295377 Apr 12 14:57:02.600242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 213/422] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:02 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:02.699893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9efd9f49-37e9-4d34-bb69-b25073a906bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:02.700569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9efd9f49-37e9-4d34-bb69-b25073a906bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:02.709742 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9efd9f49-37e9-4d34-bb69-b25073a906bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:02.710302 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9efd9f49-37e9-4d34-bb69-b25073a906bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:02.711177 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9efd9f49-37e9-4d34-bb69-b25073a906bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:02.711728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9efd9f49-37e9-4d34-bb69-b25073a906bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:02.720622 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9b1e1af9-b85c-49d9-8a56-a68c6910eaba tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:02.721340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9b1e1af9-b85c-49d9-8a56-a68c6910eaba tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:02.734224 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b1e1af9-b85c-49d9-8a56-a68c6910eaba tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:02.734770 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b1e1af9-b85c-49d9-8a56-a68c6910eaba tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:02.735771 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b1e1af9-b85c-49d9-8a56-a68c6910eaba tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:02.736284 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b1e1af9-b85c-49d9-8a56-a68c6910eaba tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:02.938379 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9efd9f49-37e9-4d34-bb69-b25073a906bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:02.952471 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9b1e1af9-b85c-49d9-8a56-a68c6910eaba tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:02.958756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9efd9f49-37e9-4d34-bb69-b25073a906bc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.269260 Apr 12 14:57:02.961668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9b1e1af9-b85c-49d9-8a56-a68c6910eaba tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1470 microversion: 2.1 time: 0.246140 Apr 12 14:57:02.970512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 210/423] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:02 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:02.972275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 214/424] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:02 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1470 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:03.627401 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6d9e1c92-55e3-4682-8fdb-3972a97c1612 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:03.627401 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6d9e1c92-55e3-4682-8fdb-3972a97c1612 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:03.630425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d9e1c92-55e3-4682-8fdb-3972a97c1612 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:03.630868 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d9e1c92-55e3-4682-8fdb-3972a97c1612 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:03.636585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d9e1c92-55e3-4682-8fdb-3972a97c1612 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:03.637377 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d9e1c92-55e3-4682-8fdb-3972a97c1612 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:03.694656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-25486d4a-5ce7-46b2-9357-7da3c12c881d req-fd8c43b2-e694-4e3b-ba26-2faec303ef3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d269e33-8e2d-4352-ba0f-c6d1470ca3fe", "name": "network-vif-deleted", "tag": "673fcf47-27a7-4822-bdb5-6b9a776150bc"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:03.708856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-25486d4a-5ce7-46b2-9357-7da3c12c881d req-fd8c43b2-e694-4e3b-ba26-2faec303ef3d service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:03.708856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-25486d4a-5ce7-46b2-9357-7da3c12c881d req-fd8c43b2-e694-4e3b-ba26-2faec303ef3d service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:03.726874 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-25486d4a-5ce7-46b2-9357-7da3c12c881d req-fd8c43b2-e694-4e3b-ba26-2faec303ef3d service nova] Creating event network-vif-deleted:673fcf47-27a7-4822-bdb5-6b9a776150bc for instance 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe on hv-cinder-83752 Apr 12 14:57:03.733930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-25486d4a-5ce7-46b2-9357-7da3c12c881d req-fd8c43b2-e694-4e3b-ba26-2faec303ef3d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042206 Apr 12 14:57:03.740034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 215/425] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:03.817853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6d9e1c92-55e3-4682-8fdb-3972a97c1612 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:03.825343 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6d9e1c92-55e3-4682-8fdb-3972a97c1612 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:03.827299 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6d9e1c92-55e3-4682-8fdb-3972a97c1612 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:03.828835 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6d9e1c92-55e3-4682-8fdb-3972a97c1612 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1721 microversion: 2.20 time: 0.210402 Apr 12 14:57:03.829396 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 211/426] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:03 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:03.980681 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-da27f01a-f050-487e-99b2-07d5027e427b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:03.981845 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-da27f01a-f050-487e-99b2-07d5027e427b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:03.982730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-df3e2c0a-439f-46bb-a359-d9a4a4b29597 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:03.983968 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-df3e2c0a-439f-46bb-a359-d9a4a4b29597 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:03.991747 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da27f01a-f050-487e-99b2-07d5027e427b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:03.992466 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da27f01a-f050-487e-99b2-07d5027e427b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:03.994301 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da27f01a-f050-487e-99b2-07d5027e427b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:03.995277 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da27f01a-f050-487e-99b2-07d5027e427b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:03.997007 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-df3e2c0a-439f-46bb-a359-d9a4a4b29597 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:03.997764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-df3e2c0a-439f-46bb-a359-d9a4a4b29597 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:03.999027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-df3e2c0a-439f-46bb-a359-d9a4a4b29597 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:03.999725 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-df3e2c0a-439f-46bb-a359-d9a4a4b29597 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:04.112315 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-df3e2c0a-439f-46bb-a359-d9a4a4b29597 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:04.121220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-df3e2c0a-439f-46bb-a359-d9a4a4b29597 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1428 microversion: 2.1 time: 0.144846 Apr 12 14:57:04.121842 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 212/427] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:03 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1428 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:04.187686 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-da27f01a-f050-487e-99b2-07d5027e427b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:04.195068 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-da27f01a-f050-487e-99b2-07d5027e427b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.221713 Apr 12 14:57:04.195647 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 216/428] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:03 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:04.847460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-83409ea1-bbca-4b64-a50d-9ea65f4d6732 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:04.848057 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-83409ea1-bbca-4b64-a50d-9ea65f4d6732 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:04.854560 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83409ea1-bbca-4b64-a50d-9ea65f4d6732 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:04.855004 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83409ea1-bbca-4b64-a50d-9ea65f4d6732 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:04.855778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83409ea1-bbca-4b64-a50d-9ea65f4d6732 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:04.856204 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83409ea1-bbca-4b64-a50d-9ea65f4d6732 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:04.985481 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-83409ea1-bbca-4b64-a50d-9ea65f4d6732 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:04.993279 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-83409ea1-bbca-4b64-a50d-9ea65f4d6732 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:04.995539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-83409ea1-bbca-4b64-a50d-9ea65f4d6732 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:04.996752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-83409ea1-bbca-4b64-a50d-9ea65f4d6732 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1721 microversion: 2.20 time: 0.153279 Apr 12 14:57:05.009121 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 213/429] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:04 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:05.141019 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1eef0ca7-0bbb-46cb-a28c-8c40462de359 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:05.141961 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1eef0ca7-0bbb-46cb-a28c-8c40462de359 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:05.149166 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1eef0ca7-0bbb-46cb-a28c-8c40462de359 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:05.149667 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1eef0ca7-0bbb-46cb-a28c-8c40462de359 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:05.151480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1eef0ca7-0bbb-46cb-a28c-8c40462de359 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:05.152119 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1eef0ca7-0bbb-46cb-a28c-8c40462de359 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:05.214843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1a544e22-5ec9-46a3-92cd-fb4f36998ef6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:05.215326 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1eef0ca7-0bbb-46cb-a28c-8c40462de359 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:05.215674 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1a544e22-5ec9-46a3-92cd-fb4f36998ef6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:05.225345 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1eef0ca7-0bbb-46cb-a28c-8c40462de359 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1428 microversion: 2.1 time: 0.085824 Apr 12 14:57:05.225566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1a544e22-5ec9-46a3-92cd-fb4f36998ef6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:05.225566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1a544e22-5ec9-46a3-92cd-fb4f36998ef6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:05.225779 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 217/430] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:05 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:05.225857 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1a544e22-5ec9-46a3-92cd-fb4f36998ef6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:05.225857 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1a544e22-5ec9-46a3-92cd-fb4f36998ef6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:05.363506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1a544e22-5ec9-46a3-92cd-fb4f36998ef6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:05.375683 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1a544e22-5ec9-46a3-92cd-fb4f36998ef6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.167026 Apr 12 14:57:05.376271 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 214/431] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:05 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:06.016418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1463ec90-c856-42c0-bccb-c28fbb8755fc tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:06.016893 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1463ec90-c856-42c0-bccb-c28fbb8755fc tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:06.023024 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1463ec90-c856-42c0-bccb-c28fbb8755fc tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:06.023281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1463ec90-c856-42c0-bccb-c28fbb8755fc tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:06.024056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1463ec90-c856-42c0-bccb-c28fbb8755fc tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:06.024487 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1463ec90-c856-42c0-bccb-c28fbb8755fc tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:06.158006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1463ec90-c856-42c0-bccb-c28fbb8755fc tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:06.167829 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1463ec90-c856-42c0-bccb-c28fbb8755fc tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:06.169492 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1463ec90-c856-42c0-bccb-c28fbb8755fc tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:06.171583 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1463ec90-c856-42c0-bccb-c28fbb8755fc tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1721 microversion: 2.20 time: 0.159636 Apr 12 14:57:06.173290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 218/432] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:06 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:06.242991 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:06.244518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:06.254352 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:06.254800 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:06.255799 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:06.256401 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:06.291473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:06.291976 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:06.292388 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lazy-loading 'fault' on Instance uuid 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:57:06.352514 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:06.364349 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5b49166c-e3c1-4077-8ff3-64c159fd62f8 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1304 microversion: 2.1 time: 0.126953 Apr 12 14:57:06.364938 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 215/433] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:06 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:06.395598 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dd96b888-1bcb-40c0-9e00-bd16c52421d4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:06.396513 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dd96b888-1bcb-40c0-9e00-bd16c52421d4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:06.406256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd96b888-1bcb-40c0-9e00-bd16c52421d4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:06.406756 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd96b888-1bcb-40c0-9e00-bd16c52421d4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:06.407634 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd96b888-1bcb-40c0-9e00-bd16c52421d4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:06.408158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd96b888-1bcb-40c0-9e00-bd16c52421d4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:06.559031 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd96b888-1bcb-40c0-9e00-bd16c52421d4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:06.566728 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dd96b888-1bcb-40c0-9e00-bd16c52421d4 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.177661 Apr 12 14:57:06.567629 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 219/434] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:06 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:06.621868 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-ccbc190b-bbd6-4e03-82f2-8b7b2298ce7b req-3f567b84-83db-4582-95be-35d46bdd3c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd692aa-e03c-4686-8512-e5b6d426893f", "name": "network-vif-plugged", "status": "completed", "tag": "d0d6b7ba-aadc-4c5d-96b6-feb347509ccf"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:06.630207 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-ccbc190b-bbd6-4e03-82f2-8b7b2298ce7b req-3f567b84-83db-4582-95be-35d46bdd3c72 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:06.630727 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-ccbc190b-bbd6-4e03-82f2-8b7b2298ce7b req-3f567b84-83db-4582-95be-35d46bdd3c72 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:06.643392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-ccbc190b-bbd6-4e03-82f2-8b7b2298ce7b req-3f567b84-83db-4582-95be-35d46bdd3c72 service nova] Creating event network-vif-plugged:d0d6b7ba-aadc-4c5d-96b6-feb347509ccf for instance dfd692aa-e03c-4686-8512-e5b6d426893f on hv-cinder-83752 Apr 12 14:57:06.648448 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-ccbc190b-bbd6-4e03-82f2-8b7b2298ce7b req-3f567b84-83db-4582-95be-35d46bdd3c72 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031258 Apr 12 14:57:06.649057 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 216/435] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:07.192072 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3860530e-f8f3-4065-96aa-f989088d36e1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:07.192633 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3860530e-f8f3-4065-96aa-f989088d36e1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:07.200939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3860530e-f8f3-4065-96aa-f989088d36e1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:07.201410 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3860530e-f8f3-4065-96aa-f989088d36e1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:07.202484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3860530e-f8f3-4065-96aa-f989088d36e1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:07.202915 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3860530e-f8f3-4065-96aa-f989088d36e1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:07.355099 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3860530e-f8f3-4065-96aa-f989088d36e1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:07.364499 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3860530e-f8f3-4065-96aa-f989088d36e1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:07.366221 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3860530e-f8f3-4065-96aa-f989088d36e1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:07.367488 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3860530e-f8f3-4065-96aa-f989088d36e1 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1664 microversion: 2.20 time: 0.179814 Apr 12 14:57:07.372520 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 220/436] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:07 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:07.388533 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:07.390317 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:07.391104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c999414b-5bbc-425d-96c2-f05c5e3c700d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53d61019-5f0c-4c43-8b84-d73cb849ec69"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:07.392373 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c999414b-5bbc-425d-96c2-f05c5e3c700d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:07.399559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c999414b-5bbc-425d-96c2-f05c5e3c700d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:07.400675 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c999414b-5bbc-425d-96c2-f05c5e3c700d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:07.401115 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:07.401539 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c999414b-5bbc-425d-96c2-f05c5e3c700d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:07.402003 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c999414b-5bbc-425d-96c2-f05c5e3c700d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:07.403030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:07.404533 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:07.405293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:07.452352 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:07.453109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:07.453811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lazy-loading 'fault' on Instance uuid 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:57:07.503989 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546c0ce913404721a6981858e34007c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab1b96ea0749b7979379be4a0175ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:07.512995 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7be1130e-ba14-4b88-8583-9b97b9c2a859 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 200 len: 1304 microversion: 2.1 time: 0.131163 Apr 12 14:57:07.513690 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 217/437] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:07 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:07.585239 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4d066ec7-9cf2-4e9f-8ec5-b80128e7572c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:07.586235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4d066ec7-9cf2-4e9f-8ec5-b80128e7572c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:07.593942 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d066ec7-9cf2-4e9f-8ec5-b80128e7572c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:07.595020 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d066ec7-9cf2-4e9f-8ec5-b80128e7572c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:07.595568 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d066ec7-9cf2-4e9f-8ec5-b80128e7572c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:07.596158 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4d066ec7-9cf2-4e9f-8ec5-b80128e7572c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:07.757338 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4d066ec7-9cf2-4e9f-8ec5-b80128e7572c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:07.767163 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4d066ec7-9cf2-4e9f-8ec5-b80128e7572c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.185801 Apr 12 14:57:07.770117 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 218/438] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:07 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:08.540194 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c999414b-5bbc-425d-96c2-f05c5e3c700d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "POST /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.153226 Apr 12 14:57:08.544200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0551f349-acca-4d3b-8360-c82f8f57fde6 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:08.545216 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0551f349-acca-4d3b-8360-c82f8f57fde6 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] [instance: 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:08.548450 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 221/439] 10.222.0.64 () {62 vars in 1363 bytes} [Tue Apr 12 14:57:07 2022] POST /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments => generated 188 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:57:08.565183 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0551f349-acca-4d3b-8360-c82f8f57fde6 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:08.565771 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0551f349-acca-4d3b-8360-c82f8f57fde6 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:08.568021 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0551f349-acca-4d3b-8360-c82f8f57fde6 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:08.568021 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0551f349-acca-4d3b-8360-c82f8f57fde6 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:08.587037 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-0551f349-acca-4d3b-8360-c82f8f57fde6 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] HTTP exception thrown: Instance 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe could not be found. Apr 12 14:57:08.588830 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0551f349-acca-4d3b-8360-c82f8f57fde6 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] Returning 404 to user: Instance 2d269e33-8e2d-4352-ba0f-c6d1470ca3fe could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:57:08.589891 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0551f349-acca-4d3b-8360-c82f8f57fde6 tempest-VolumesNegativeTest-401473144 tempest-VolumesNegativeTest-401473144-project] 10.222.0.64 "GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe" status: 404 len: 111 microversion: 2.1 time: 0.052063 Apr 12 14:57:08.594138 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 219/440] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:08 2022] GET /compute/v2.1/servers/2d269e33-8e2d-4352-ba0f-c6d1470ca3fe => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:57:08.689290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2bbcd98d-3957-4f29-af65-c00caf5efe8e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:08.689563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2bbcd98d-3957-4f29-af65-c00caf5efe8e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:08.696481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2bbcd98d-3957-4f29-af65-c00caf5efe8e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:08.697148 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2bbcd98d-3957-4f29-af65-c00caf5efe8e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:08.698184 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2bbcd98d-3957-4f29-af65-c00caf5efe8e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:08.698621 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2bbcd98d-3957-4f29-af65-c00caf5efe8e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:08.786097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-85329310-11ab-488d-aba2-ab07f98ed468 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:08.786097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-85329310-11ab-488d-aba2-ab07f98ed468 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:08.792618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-85329310-11ab-488d-aba2-ab07f98ed468 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:08.793116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-85329310-11ab-488d-aba2-ab07f98ed468 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:08.793912 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-85329310-11ab-488d-aba2-ab07f98ed468 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:08.794348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-85329310-11ab-488d-aba2-ab07f98ed468 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:08.987445 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-85329310-11ab-488d-aba2-ab07f98ed468 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:08.995515 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-85329310-11ab-488d-aba2-ab07f98ed468 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1369 microversion: 2.1 time: 0.214657 Apr 12 14:57:08.996102 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 220/441] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:08 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1369 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:09.023587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2bbcd98d-3957-4f29-af65-c00caf5efe8e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "POST /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/action" status: 202 len: 0 microversion: 2.20 time: 0.339209 Apr 12 14:57:09.024291 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 222/442] 10.222.0.64 () {62 vars in 1318 bytes} [Tue Apr 12 14:57:08 2022] POST /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 14:57:09.036905 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b59d691c-d8b7-4648-a9a2-dc13e7915a08 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:09.037789 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b59d691c-d8b7-4648-a9a2-dc13e7915a08 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:09.044706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b59d691c-d8b7-4648-a9a2-dc13e7915a08 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:09.045159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b59d691c-d8b7-4648-a9a2-dc13e7915a08 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:09.045960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b59d691c-d8b7-4648-a9a2-dc13e7915a08 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:09.046552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b59d691c-d8b7-4648-a9a2-dc13e7915a08 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:09.192235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b59d691c-d8b7-4648-a9a2-dc13e7915a08 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:09.203569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b59d691c-d8b7-4648-a9a2-dc13e7915a08 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:09.205089 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b59d691c-d8b7-4648-a9a2-dc13e7915a08 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:09.206280 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b59d691c-d8b7-4648-a9a2-dc13e7915a08 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1750 microversion: 2.20 time: 0.173220 Apr 12 14:57:09.206900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 221/443] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:09 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:10.020154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d8478f38-19e3-482c-93ca-47a7a6054922 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:10.027456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d8478f38-19e3-482c-93ca-47a7a6054922 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:10.041200 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d8478f38-19e3-482c-93ca-47a7a6054922 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:10.043104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d8478f38-19e3-482c-93ca-47a7a6054922 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:10.044727 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d8478f38-19e3-482c-93ca-47a7a6054922 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:10.046158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d8478f38-19e3-482c-93ca-47a7a6054922 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:10.226067 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1204c929-e9ba-427a-923c-556c64797854 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:10.226603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1204c929-e9ba-427a-923c-556c64797854 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:10.250932 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1204c929-e9ba-427a-923c-556c64797854 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:10.254391 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1204c929-e9ba-427a-923c-556c64797854 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:10.259974 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1204c929-e9ba-427a-923c-556c64797854 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:10.260740 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1204c929-e9ba-427a-923c-556c64797854 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:10.500072 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d8478f38-19e3-482c-93ca-47a7a6054922 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:10.516156 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d8478f38-19e3-482c-93ca-47a7a6054922 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1563 microversion: 2.1 time: 0.504520 Apr 12 14:57:10.526689 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 223/444] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:10 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1563 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:10.550032 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8b8967ec-13a0-4aff-b789-58f87c56c321 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:10.550842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8b8967ec-13a0-4aff-b789-58f87c56c321 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:10.562949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8b8967ec-13a0-4aff-b789-58f87c56c321 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:10.564148 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8b8967ec-13a0-4aff-b789-58f87c56c321 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:10.565731 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8b8967ec-13a0-4aff-b789-58f87c56c321 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:10.566701 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8b8967ec-13a0-4aff-b789-58f87c56c321 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:10.592018 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1204c929-e9ba-427a-923c-556c64797854 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:10.620261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1204c929-e9ba-427a-923c-556c64797854 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:10.622075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1204c929-e9ba-427a-923c-556c64797854 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:10.624258 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1204c929-e9ba-427a-923c-556c64797854 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1750 microversion: 2.20 time: 0.402367 Apr 12 14:57:10.644923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 222/445] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:10 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1750 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:57:10.734317 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8b8967ec-13a0-4aff-b789-58f87c56c321 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196694 Apr 12 14:57:10.734989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 224/446] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Apr 12 14:57:10 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:57:11.654367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bc010e6b-3946-4fb6-ad77-715a12bf867c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:11.655910 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bc010e6b-3946-4fb6-ad77-715a12bf867c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:11.665002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc010e6b-3946-4fb6-ad77-715a12bf867c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:11.666817 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc010e6b-3946-4fb6-ad77-715a12bf867c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:11.667409 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc010e6b-3946-4fb6-ad77-715a12bf867c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:11.668069 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc010e6b-3946-4fb6-ad77-715a12bf867c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:11.976040 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bc010e6b-3946-4fb6-ad77-715a12bf867c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:11.990212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bc010e6b-3946-4fb6-ad77-715a12bf867c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:11.993235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bc010e6b-3946-4fb6-ad77-715a12bf867c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:11.995933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bc010e6b-3946-4fb6-ad77-715a12bf867c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1752 microversion: 2.20 time: 0.346918 Apr 12 14:57:11.997238 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 223/447] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:11 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1752 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:12.291826 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-822d07be-f328-4724-992a-2d7d6c50a87e req-449c148b-8f8c-4973-ad44-cbd6c46b4918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd692aa-e03c-4686-8512-e5b6d426893f", "tag": "d0d6b7ba-aadc-4c5d-96b6-feb347509ccf"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:12.303216 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-822d07be-f328-4724-992a-2d7d6c50a87e req-449c148b-8f8c-4973-ad44-cbd6c46b4918 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:12.303984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-822d07be-f328-4724-992a-2d7d6c50a87e req-449c148b-8f8c-4973-ad44-cbd6c46b4918 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:12.319668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-822d07be-f328-4724-992a-2d7d6c50a87e req-449c148b-8f8c-4973-ad44-cbd6c46b4918 service nova] Creating event network-changed:d0d6b7ba-aadc-4c5d-96b6-feb347509ccf for instance dfd692aa-e03c-4686-8512-e5b6d426893f on hv-cinder-83752 Apr 12 14:57:12.327738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-822d07be-f328-4724-992a-2d7d6c50a87e req-449c148b-8f8c-4973-ad44-cbd6c46b4918 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041154 Apr 12 14:57:12.328815 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 225/448] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:13.016570 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f44a9ddd-5fc7-4ff1-85b8-de4732646853 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:13.017448 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f44a9ddd-5fc7-4ff1-85b8-de4732646853 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:13.041221 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f44a9ddd-5fc7-4ff1-85b8-de4732646853 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:13.043320 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f44a9ddd-5fc7-4ff1-85b8-de4732646853 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:13.044461 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f44a9ddd-5fc7-4ff1-85b8-de4732646853 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:13.045061 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f44a9ddd-5fc7-4ff1-85b8-de4732646853 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:13.369485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f44a9ddd-5fc7-4ff1-85b8-de4732646853 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:13.385013 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f44a9ddd-5fc7-4ff1-85b8-de4732646853 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:13.386782 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f44a9ddd-5fc7-4ff1-85b8-de4732646853 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:13.401451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f44a9ddd-5fc7-4ff1-85b8-de4732646853 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1752 microversion: 2.20 time: 0.376526 Apr 12 14:57:13.411918 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 224/449] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:13 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1752 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:14.426905 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8d3f204d-f364-4827-ab3b-2d635f2221ef tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:14.427613 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8d3f204d-f364-4827-ab3b-2d635f2221ef tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:14.439041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d3f204d-f364-4827-ab3b-2d635f2221ef tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:14.439642 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d3f204d-f364-4827-ab3b-2d635f2221ef tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:14.440268 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d3f204d-f364-4827-ab3b-2d635f2221ef tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:14.440700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d3f204d-f364-4827-ab3b-2d635f2221ef tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:15.007199 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8d3f204d-f364-4827-ab3b-2d635f2221ef tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:15.025234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8d3f204d-f364-4827-ab3b-2d635f2221ef tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:15.030776 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8d3f204d-f364-4827-ab3b-2d635f2221ef tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:15.035237 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8d3f204d-f364-4827-ab3b-2d635f2221ef tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.615752 Apr 12 14:57:15.037995 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 226/450] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:14 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:16.079775 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2e7c997c-3c1b-42bd-aaad-debea82be602 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:16.080323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2e7c997c-3c1b-42bd-aaad-debea82be602 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:16.096561 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e7c997c-3c1b-42bd-aaad-debea82be602 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:16.104641 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e7c997c-3c1b-42bd-aaad-debea82be602 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:16.104641 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e7c997c-3c1b-42bd-aaad-debea82be602 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:16.104641 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2e7c997c-3c1b-42bd-aaad-debea82be602 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:16.320698 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2e7c997c-3c1b-42bd-aaad-debea82be602 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:16.342608 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2e7c997c-3c1b-42bd-aaad-debea82be602 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:16.345274 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2e7c997c-3c1b-42bd-aaad-debea82be602 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:16.346828 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2e7c997c-3c1b-42bd-aaad-debea82be602 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.283692 Apr 12 14:57:16.347785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 225/451] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:16 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:17.375079 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3efa93fe-76c3-4f62-99d8-41843ac1e66a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:17.375882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3efa93fe-76c3-4f62-99d8-41843ac1e66a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:17.388641 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3efa93fe-76c3-4f62-99d8-41843ac1e66a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:17.389120 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3efa93fe-76c3-4f62-99d8-41843ac1e66a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:17.394034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3efa93fe-76c3-4f62-99d8-41843ac1e66a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:17.395579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3efa93fe-76c3-4f62-99d8-41843ac1e66a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:17.787021 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3efa93fe-76c3-4f62-99d8-41843ac1e66a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:17.814349 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3efa93fe-76c3-4f62-99d8-41843ac1e66a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:17.819176 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3efa93fe-76c3-4f62-99d8-41843ac1e66a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:17.825318 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3efa93fe-76c3-4f62-99d8-41843ac1e66a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.455815 Apr 12 14:57:17.839920 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 227/452] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:17 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:18.844544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5e089083-3a8e-4bd1-aaea-3c88423e06e6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:18.846027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5e089083-3a8e-4bd1-aaea-3c88423e06e6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:18.856564 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5e089083-3a8e-4bd1-aaea-3c88423e06e6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:18.857670 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5e089083-3a8e-4bd1-aaea-3c88423e06e6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:18.859551 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5e089083-3a8e-4bd1-aaea-3c88423e06e6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:18.870289 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5e089083-3a8e-4bd1-aaea-3c88423e06e6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:19.055194 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5e089083-3a8e-4bd1-aaea-3c88423e06e6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:19.070800 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5e089083-3a8e-4bd1-aaea-3c88423e06e6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:19.074130 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5e089083-3a8e-4bd1-aaea-3c88423e06e6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:19.075667 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5e089083-3a8e-4bd1-aaea-3c88423e06e6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.235180 Apr 12 14:57:19.077238 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 226/453] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:18 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:20.095385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4b2181e0-05eb-4793-a056-ced5b0ade3e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:20.095978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4b2181e0-05eb-4793-a056-ced5b0ade3e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:20.107996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4b2181e0-05eb-4793-a056-ced5b0ade3e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:20.108236 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4b2181e0-05eb-4793-a056-ced5b0ade3e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:20.108851 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4b2181e0-05eb-4793-a056-ced5b0ade3e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:20.109288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4b2181e0-05eb-4793-a056-ced5b0ade3e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:20.419012 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4b2181e0-05eb-4793-a056-ced5b0ade3e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:20.432378 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4b2181e0-05eb-4793-a056-ced5b0ade3e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:20.434128 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4b2181e0-05eb-4793-a056-ced5b0ade3e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:20.435529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4b2181e0-05eb-4793-a056-ced5b0ade3e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.344277 Apr 12 14:57:20.436672 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 228/454] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:20 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:21.455869 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-620aacf1-f506-4f79-ac09-fcd9c65eb6f3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:21.461141 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-620aacf1-f506-4f79-ac09-fcd9c65eb6f3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:21.465117 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-620aacf1-f506-4f79-ac09-fcd9c65eb6f3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:21.465741 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-620aacf1-f506-4f79-ac09-fcd9c65eb6f3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:21.466637 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-620aacf1-f506-4f79-ac09-fcd9c65eb6f3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:21.467189 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-620aacf1-f506-4f79-ac09-fcd9c65eb6f3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:21.694059 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-620aacf1-f506-4f79-ac09-fcd9c65eb6f3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:21.712309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-620aacf1-f506-4f79-ac09-fcd9c65eb6f3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:21.714579 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-620aacf1-f506-4f79-ac09-fcd9c65eb6f3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:21.716096 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-620aacf1-f506-4f79-ac09-fcd9c65eb6f3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.264144 Apr 12 14:57:21.730212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 227/455] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:21 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:22.744101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-de06658d-6f1d-4f46-991e-c0da0d6485f4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:22.745717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-de06658d-6f1d-4f46-991e-c0da0d6485f4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:22.757076 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de06658d-6f1d-4f46-991e-c0da0d6485f4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:22.757956 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de06658d-6f1d-4f46-991e-c0da0d6485f4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:22.760100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de06658d-6f1d-4f46-991e-c0da0d6485f4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:22.760938 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de06658d-6f1d-4f46-991e-c0da0d6485f4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:22.968656 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-46e4aa5c-4a12-47ea-a516-5b0827211b93 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:22.969455 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-46e4aa5c-4a12-47ea-a516-5b0827211b93 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:22.990942 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-46e4aa5c-4a12-47ea-a516-5b0827211b93 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:22.991787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-46e4aa5c-4a12-47ea-a516-5b0827211b93 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:22.995679 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-46e4aa5c-4a12-47ea-a516-5b0827211b93 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:22.996364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-46e4aa5c-4a12-47ea-a516-5b0827211b93 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:23.025535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-de06658d-6f1d-4f46-991e-c0da0d6485f4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:23.038198 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-de06658d-6f1d-4f46-991e-c0da0d6485f4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:23.040948 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-de06658d-6f1d-4f46-991e-c0da0d6485f4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:23.042731 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-de06658d-6f1d-4f46-991e-c0da0d6485f4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.310088 Apr 12 14:57:23.054990 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 229/456] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:22 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:23.554593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-46e4aa5c-4a12-47ea-a516-5b0827211b93 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lazy-loading 'services' on Instance uuid cc3e6773-eb1f-4098-b443-1b2d62d1abe8 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:57:24.065234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-75009510-46e0-4399-abc4-ce368db87640 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:24.081056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-75009510-46e0-4399-abc4-ce368db87640 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:24.081056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75009510-46e0-4399-abc4-ce368db87640 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:24.081056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75009510-46e0-4399-abc4-ce368db87640 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:24.081056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75009510-46e0-4399-abc4-ce368db87640 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:24.081416 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75009510-46e0-4399-abc4-ce368db87640 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:24.228689 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-46e4aa5c-4a12-47ea-a516-5b0827211b93 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "DELETE /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/os-volume_attachments/2dc08b93-3847-409c-94bb-f0b7178a30a6" status: 202 len: 0 microversion: 2.1 time: 1.269155 Apr 12 14:57:24.230265 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 228/457] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Apr 12 14:57:22 2022] DELETE /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/os-volume_attachments/2dc08b93-3847-409c-94bb-f0b7178a30a6 => generated 0 bytes in 1272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:57:24.357580 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-75009510-46e0-4399-abc4-ce368db87640 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:24.367563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-75009510-46e0-4399-abc4-ce368db87640 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:24.369879 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-75009510-46e0-4399-abc4-ce368db87640 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:24.371550 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-75009510-46e0-4399-abc4-ce368db87640 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.311606 Apr 12 14:57:24.372749 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 230/458] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:24 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:57:25.391519 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-704c8939-8cf6-4636-b65e-93f39a9236df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:25.392210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-704c8939-8cf6-4636-b65e-93f39a9236df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:25.417665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-704c8939-8cf6-4636-b65e-93f39a9236df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:25.418442 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-704c8939-8cf6-4636-b65e-93f39a9236df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:25.419406 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-704c8939-8cf6-4636-b65e-93f39a9236df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:25.422386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-704c8939-8cf6-4636-b65e-93f39a9236df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:25.748075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-704c8939-8cf6-4636-b65e-93f39a9236df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:25.765739 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-704c8939-8cf6-4636-b65e-93f39a9236df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:25.768331 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-704c8939-8cf6-4636-b65e-93f39a9236df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:25.771073 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-704c8939-8cf6-4636-b65e-93f39a9236df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.384552 Apr 12 14:57:25.777413 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 229/459] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:25 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:57:26.104957 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-81055721-b35c-4dec-b086-51c16865a165 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Action: 'create', calling method: .version_select at 0x7fbd60997af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1413510922"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:26.119066 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-81055721-b35c-4dec-b086-51c16865a165 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Getting quotas for project ab3ab5283430466e9ab0b79750fc4e96. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:57:26.123624 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-81055721-b35c-4dec-b086-51c16865a165 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Getting quotas for user 7b11e20132894393bdaf9b8fb4508ab8 and project ab3ab5283430466e9ab0b79750fc4e96. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:57:26.389788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-81055721-b35c-4dec-b086-51c16865a165 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Getting quotas for project ab3ab5283430466e9ab0b79750fc4e96. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:57:26.394780 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-81055721-b35c-4dec-b086-51c16865a165 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Getting quotas for user 7b11e20132894393bdaf9b8fb4508ab8 and project ab3ab5283430466e9ab0b79750fc4e96. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:57:26.410042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-81055721-b35c-4dec-b086-51c16865a165 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.493306 Apr 12 14:57:26.415279 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 231/460] 10.222.0.64 () {60 vars in 1157 bytes} [Tue Apr 12 14:57:25 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:26.792232 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b5f1c258-191e-4238-8058-3ed6904e91df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:26.796379 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b5f1c258-191e-4238-8058-3ed6904e91df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:26.799306 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b5f1c258-191e-4238-8058-3ed6904e91df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:26.799753 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b5f1c258-191e-4238-8058-3ed6904e91df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:26.800581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b5f1c258-191e-4238-8058-3ed6904e91df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:26.800998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b5f1c258-191e-4238-8058-3ed6904e91df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:26.945463 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b5f1c258-191e-4238-8058-3ed6904e91df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:26.956245 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b5f1c258-191e-4238-8058-3ed6904e91df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:26.957966 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b5f1c258-191e-4238-8058-3ed6904e91df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:26.959271 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b5f1c258-191e-4238-8058-3ed6904e91df tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.171252 Apr 12 14:57:26.959921 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 230/461] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:26 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:27.983227 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4e3bf042-c201-440d-b80a-faefd763827d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:27.984471 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4e3bf042-c201-440d-b80a-faefd763827d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:28.018801 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e3bf042-c201-440d-b80a-faefd763827d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:28.019550 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e3bf042-c201-440d-b80a-faefd763827d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:28.020536 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e3bf042-c201-440d-b80a-faefd763827d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:28.021728 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e3bf042-c201-440d-b80a-faefd763827d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:28.214834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4e3bf042-c201-440d-b80a-faefd763827d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:28.220148 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4e3bf042-c201-440d-b80a-faefd763827d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:28.221775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4e3bf042-c201-440d-b80a-faefd763827d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:28.223127 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4e3bf042-c201-440d-b80a-faefd763827d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.247025 Apr 12 14:57:28.223819 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 232/462] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:27 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:29.010453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3b9d2daa-5fa1-4165-b2a6-3b5befdc269e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:29.017213 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3b9d2daa-5fa1-4165-b2a6-3b5befdc269e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:29.017776 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3b9d2daa-5fa1-4165-b2a6-3b5befdc269e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:29.048543 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3b9d2daa-5fa1-4165-b2a6-3b5befdc269e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Going to try to stop instance {{(pid=124199) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 12 14:57:29.245735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0d55c99b-5f8b-4402-b732-290790bb69a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:29.246584 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0d55c99b-5f8b-4402-b732-290790bb69a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:29.252905 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0d55c99b-5f8b-4402-b732-290790bb69a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:29.253358 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0d55c99b-5f8b-4402-b732-290790bb69a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:29.254166 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0d55c99b-5f8b-4402-b732-290790bb69a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:29.254597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0d55c99b-5f8b-4402-b732-290790bb69a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:29.285750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3b9d2daa-5fa1-4165-b2a6-3b5befdc269e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/action" status: 202 len: 0 microversion: 2.1 time: 0.270537 Apr 12 14:57:29.288333 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 231/463] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 14:57:29 2022] POST /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:57:29.303316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a22dd81f-2fa0-4a65-9fcb-659096464d7f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:29.311461 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a22dd81f-2fa0-4a65-9fcb-659096464d7f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:29.330783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a22dd81f-2fa0-4a65-9fcb-659096464d7f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:29.331305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a22dd81f-2fa0-4a65-9fcb-659096464d7f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:29.332143 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a22dd81f-2fa0-4a65-9fcb-659096464d7f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:29.332579 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a22dd81f-2fa0-4a65-9fcb-659096464d7f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:29.562993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0d55c99b-5f8b-4402-b732-290790bb69a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:29.572731 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0d55c99b-5f8b-4402-b732-290790bb69a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:29.581395 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0d55c99b-5f8b-4402-b732-290790bb69a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:29.582957 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0d55c99b-5f8b-4402-b732-290790bb69a6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.343524 Apr 12 14:57:29.586067 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 233/464] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:29 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:29.618493 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a22dd81f-2fa0-4a65-9fcb-659096464d7f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:29.624203 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a22dd81f-2fa0-4a65-9fcb-659096464d7f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.330510 Apr 12 14:57:29.624855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 232/465] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:29 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:30.610695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d4487831-98b9-4649-a8dc-9104c21bb158 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:30.613302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d4487831-98b9-4649-a8dc-9104c21bb158 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:30.622133 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4487831-98b9-4649-a8dc-9104c21bb158 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:30.622620 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4487831-98b9-4649-a8dc-9104c21bb158 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:30.623426 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4487831-98b9-4649-a8dc-9104c21bb158 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:30.623862 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4487831-98b9-4649-a8dc-9104c21bb158 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:30.643303 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b99e8f4d-0322-4b27-8cb6-0e21c0d3628e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:30.644033 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b99e8f4d-0322-4b27-8cb6-0e21c0d3628e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:30.651038 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b99e8f4d-0322-4b27-8cb6-0e21c0d3628e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:30.651701 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b99e8f4d-0322-4b27-8cb6-0e21c0d3628e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:30.652594 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b99e8f4d-0322-4b27-8cb6-0e21c0d3628e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:30.653135 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b99e8f4d-0322-4b27-8cb6-0e21c0d3628e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:30.829722 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d4487831-98b9-4649-a8dc-9104c21bb158 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:30.838793 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d4487831-98b9-4649-a8dc-9104c21bb158 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:30.840470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d4487831-98b9-4649-a8dc-9104c21bb158 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:30.841660 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d4487831-98b9-4649-a8dc-9104c21bb158 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.236491 Apr 12 14:57:30.845222 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b99e8f4d-0322-4b27-8cb6-0e21c0d3628e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:30.845364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 234/466] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:30 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:57:30.849566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b99e8f4d-0322-4b27-8cb6-0e21c0d3628e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.210196 Apr 12 14:57:30.850432 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 233/467] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:30 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:31.860345 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ee30a725-c3f6-4ad9-9f70-70c05f3a797b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:31.860937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ee30a725-c3f6-4ad9-9f70-70c05f3a797b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:31.868305 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ee30a725-c3f6-4ad9-9f70-70c05f3a797b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:31.868753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ee30a725-c3f6-4ad9-9f70-70c05f3a797b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:31.869495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f49d4bc8-a448-4df0-b968-d6b0f9e69ab3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:31.870006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ee30a725-c3f6-4ad9-9f70-70c05f3a797b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:31.870006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ee30a725-c3f6-4ad9-9f70-70c05f3a797b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:31.870203 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f49d4bc8-a448-4df0-b968-d6b0f9e69ab3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:31.878753 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f49d4bc8-a448-4df0-b968-d6b0f9e69ab3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:31.879198 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f49d4bc8-a448-4df0-b968-d6b0f9e69ab3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:31.879977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f49d4bc8-a448-4df0-b968-d6b0f9e69ab3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:31.880404 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f49d4bc8-a448-4df0-b968-d6b0f9e69ab3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:32.088749 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ee30a725-c3f6-4ad9-9f70-70c05f3a797b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:32.092252 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f49d4bc8-a448-4df0-b968-d6b0f9e69ab3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:32.097781 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ee30a725-c3f6-4ad9-9f70-70c05f3a797b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:32.099424 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ee30a725-c3f6-4ad9-9f70-70c05f3a797b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:32.100673 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ee30a725-c3f6-4ad9-9f70-70c05f3a797b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.244225 Apr 12 14:57:32.101331 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 235/468] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:31 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:32.101475 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f49d4bc8-a448-4df0-b968-d6b0f9e69ab3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.236992 Apr 12 14:57:32.102542 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 234/469] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:31 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:33.119856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d4b1e9b0-7e63-45d6-b133-536911fefc65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:33.120497 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-515dc8a5-7834-4b58-96ae-8813baa81b36 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:33.120865 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d4b1e9b0-7e63-45d6-b133-536911fefc65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:33.121049 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-515dc8a5-7834-4b58-96ae-8813baa81b36 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:33.127026 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4b1e9b0-7e63-45d6-b133-536911fefc65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:33.127469 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4b1e9b0-7e63-45d6-b133-536911fefc65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:33.127760 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-515dc8a5-7834-4b58-96ae-8813baa81b36 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:33.128212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-515dc8a5-7834-4b58-96ae-8813baa81b36 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:33.128310 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4b1e9b0-7e63-45d6-b133-536911fefc65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:33.128650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4b1e9b0-7e63-45d6-b133-536911fefc65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:33.128993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-515dc8a5-7834-4b58-96ae-8813baa81b36 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:33.129431 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-515dc8a5-7834-4b58-96ae-8813baa81b36 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:33.339673 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d4b1e9b0-7e63-45d6-b133-536911fefc65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:33.343429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-515dc8a5-7834-4b58-96ae-8813baa81b36 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:33.347341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d4b1e9b0-7e63-45d6-b133-536911fefc65 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.232572 Apr 12 14:57:33.347899 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 236/470] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:33 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:33.352842 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-515dc8a5-7834-4b58-96ae-8813baa81b36 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:33.354449 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-515dc8a5-7834-4b58-96ae-8813baa81b36 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:33.355732 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-515dc8a5-7834-4b58-96ae-8813baa81b36 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.239702 Apr 12 14:57:33.356384 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 235/471] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:33 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:34.365723 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-eeefed9a-6f1a-48da-a438-597f7f8acbf6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:34.366430 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-eeefed9a-6f1a-48da-a438-597f7f8acbf6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:34.374768 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eeefed9a-6f1a-48da-a438-597f7f8acbf6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:34.375226 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eeefed9a-6f1a-48da-a438-597f7f8acbf6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:34.375488 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-69790f5b-02fe-4fb5-af3d-67c80214fda4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:34.376058 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eeefed9a-6f1a-48da-a438-597f7f8acbf6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:34.376164 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-69790f5b-02fe-4fb5-af3d-67c80214fda4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:34.376448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eeefed9a-6f1a-48da-a438-597f7f8acbf6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:34.382848 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69790f5b-02fe-4fb5-af3d-67c80214fda4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:34.383406 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69790f5b-02fe-4fb5-af3d-67c80214fda4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:34.384294 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69790f5b-02fe-4fb5-af3d-67c80214fda4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:34.384775 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69790f5b-02fe-4fb5-af3d-67c80214fda4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:34.578980 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-eeefed9a-6f1a-48da-a438-597f7f8acbf6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:34.587552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-eeefed9a-6f1a-48da-a438-597f7f8acbf6 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.225660 Apr 12 14:57:34.597811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-69790f5b-02fe-4fb5-af3d-67c80214fda4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:34.598233 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 237/472] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:34 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:34.604786 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-69790f5b-02fe-4fb5-af3d-67c80214fda4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:34.606344 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-69790f5b-02fe-4fb5-af3d-67c80214fda4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:34.607522 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-69790f5b-02fe-4fb5-af3d-67c80214fda4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.236382 Apr 12 14:57:34.608080 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 236/473] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:34 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:57:35.605100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-94f67b55-3d9b-469f-8852-2602ca758da1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:35.605949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-94f67b55-3d9b-469f-8852-2602ca758da1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:35.611995 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94f67b55-3d9b-469f-8852-2602ca758da1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:35.612438 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94f67b55-3d9b-469f-8852-2602ca758da1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:35.613204 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94f67b55-3d9b-469f-8852-2602ca758da1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:35.613648 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94f67b55-3d9b-469f-8852-2602ca758da1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:35.627256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c7e8decd-8478-493c-bc40-26fc85089425 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:35.629199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c7e8decd-8478-493c-bc40-26fc85089425 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:35.637925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7e8decd-8478-493c-bc40-26fc85089425 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:35.637925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7e8decd-8478-493c-bc40-26fc85089425 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:35.638293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7e8decd-8478-493c-bc40-26fc85089425 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:35.638707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c7e8decd-8478-493c-bc40-26fc85089425 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:35.810135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-94f67b55-3d9b-469f-8852-2602ca758da1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:35.818170 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-94f67b55-3d9b-469f-8852-2602ca758da1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.217485 Apr 12 14:57:35.819057 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 238/474] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:35 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:35.838909 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c7e8decd-8478-493c-bc40-26fc85089425 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:35.847362 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c7e8decd-8478-493c-bc40-26fc85089425 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:35.848867 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c7e8decd-8478-493c-bc40-26fc85089425 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:35.850091 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c7e8decd-8478-493c-bc40-26fc85089425 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.227703 Apr 12 14:57:35.850785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 237/475] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:35 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:57:36.694861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-e686bd77-5c96-42de-b608-5f9bb2b75bc5 req-cadc5fae-a609-47b6-8a91-7a662ccd8180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d03f42e-2d51-459d-ade0-7e6a34283867", "name": "network-vif-plugged", "status": "completed", "tag": "90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:36.704073 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-e686bd77-5c96-42de-b608-5f9bb2b75bc5 req-cadc5fae-a609-47b6-8a91-7a662ccd8180 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:36.704513 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-e686bd77-5c96-42de-b608-5f9bb2b75bc5 req-cadc5fae-a609-47b6-8a91-7a662ccd8180 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:36.716866 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-e686bd77-5c96-42de-b608-5f9bb2b75bc5 req-cadc5fae-a609-47b6-8a91-7a662ccd8180 service nova] Creating event network-vif-plugged:90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77 for instance 9d03f42e-2d51-459d-ade0-7e6a34283867 on hv-cinder-83752 Apr 12 14:57:36.722996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-e686bd77-5c96-42de-b608-5f9bb2b75bc5 req-cadc5fae-a609-47b6-8a91-7a662ccd8180 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032086 Apr 12 14:57:36.723600 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 239/476] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:36.838043 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-06feb7b5-b851-423c-8cde-cabaaa5ab4e4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:36.838659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-06feb7b5-b851-423c-8cde-cabaaa5ab4e4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:36.845135 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-06feb7b5-b851-423c-8cde-cabaaa5ab4e4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:36.845599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-06feb7b5-b851-423c-8cde-cabaaa5ab4e4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:36.846405 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-06feb7b5-b851-423c-8cde-cabaaa5ab4e4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:36.846826 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-06feb7b5-b851-423c-8cde-cabaaa5ab4e4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:36.869968 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fc725731-0ecb-4473-8bec-757153d19b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:36.871007 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fc725731-0ecb-4473-8bec-757153d19b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:36.877320 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc725731-0ecb-4473-8bec-757153d19b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:36.879190 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc725731-0ecb-4473-8bec-757153d19b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:36.879190 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc725731-0ecb-4473-8bec-757153d19b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:36.888231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc725731-0ecb-4473-8bec-757153d19b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:37.056880 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-06feb7b5-b851-423c-8cde-cabaaa5ab4e4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:37.064980 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-06feb7b5-b851-423c-8cde-cabaaa5ab4e4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.231831 Apr 12 14:57:37.065888 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 238/477] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:36 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:37.085900 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fc725731-0ecb-4473-8bec-757153d19b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:37.095476 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fc725731-0ecb-4473-8bec-757153d19b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:37.096973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fc725731-0ecb-4473-8bec-757153d19b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:37.098154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fc725731-0ecb-4473-8bec-757153d19b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.232616 Apr 12 14:57:37.098739 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 240/478] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:36 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:38.083182 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c142070a-4811-4ef1-ae86-7b178b8448c1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:38.083787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c142070a-4811-4ef1-ae86-7b178b8448c1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:38.091303 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c142070a-4811-4ef1-ae86-7b178b8448c1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:38.091747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c142070a-4811-4ef1-ae86-7b178b8448c1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:38.092517 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c142070a-4811-4ef1-ae86-7b178b8448c1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:38.092948 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c142070a-4811-4ef1-ae86-7b178b8448c1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:38.116489 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9b2c25cb-7795-40e8-ad72-a4efd67d9ff7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:38.117087 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9b2c25cb-7795-40e8-ad72-a4efd67d9ff7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:38.126994 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b2c25cb-7795-40e8-ad72-a4efd67d9ff7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:38.127434 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b2c25cb-7795-40e8-ad72-a4efd67d9ff7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:38.128207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b2c25cb-7795-40e8-ad72-a4efd67d9ff7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:38.128633 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b2c25cb-7795-40e8-ad72-a4efd67d9ff7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:38.282299 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c142070a-4811-4ef1-ae86-7b178b8448c1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:38.290255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c142070a-4811-4ef1-ae86-7b178b8448c1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.210629 Apr 12 14:57:38.290889 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 239/479] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:38 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:38.312145 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9b2c25cb-7795-40e8-ad72-a4efd67d9ff7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:38.321173 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9b2c25cb-7795-40e8-ad72-a4efd67d9ff7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:38.322895 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9b2c25cb-7795-40e8-ad72-a4efd67d9ff7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:38.324051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9b2c25cb-7795-40e8-ad72-a4efd67d9ff7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.211572 Apr 12 14:57:38.324616 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 241/480] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:38 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:57:39.308845 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dc3ebabe-1b5a-43d5-9c6a-abde8844a65a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:39.309749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dc3ebabe-1b5a-43d5-9c6a-abde8844a65a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:39.319250 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3ebabe-1b5a-43d5-9c6a-abde8844a65a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:39.319891 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3ebabe-1b5a-43d5-9c6a-abde8844a65a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:39.321443 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3ebabe-1b5a-43d5-9c6a-abde8844a65a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:39.322026 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3ebabe-1b5a-43d5-9c6a-abde8844a65a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:39.343133 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4bfbc86f-b413-488b-90ee-abbf3c1d4b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:39.343722 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4bfbc86f-b413-488b-90ee-abbf3c1d4b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:39.350265 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4bfbc86f-b413-488b-90ee-abbf3c1d4b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:39.350708 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4bfbc86f-b413-488b-90ee-abbf3c1d4b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:39.351480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4bfbc86f-b413-488b-90ee-abbf3c1d4b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:39.351958 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4bfbc86f-b413-488b-90ee-abbf3c1d4b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:39.531537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dc3ebabe-1b5a-43d5-9c6a-abde8844a65a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:39.543845 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4bfbc86f-b413-488b-90ee-abbf3c1d4b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:39.544892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dc3ebabe-1b5a-43d5-9c6a-abde8844a65a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.240497 Apr 12 14:57:39.546212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 240/481] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:39 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:39.552838 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4bfbc86f-b413-488b-90ee-abbf3c1d4b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:39.555407 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4bfbc86f-b413-488b-90ee-abbf3c1d4b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:39.559367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4bfbc86f-b413-488b-90ee-abbf3c1d4b13 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1808 microversion: 2.20 time: 0.218741 Apr 12 14:57:39.559367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 242/482] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:39 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:57:40.409412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c2355e6a-5c21-4a51-b5fd-d9cbe4e438c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:40.410051 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c2355e6a-5c21-4a51-b5fd-d9cbe4e438c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:40.417569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2355e6a-5c21-4a51-b5fd-d9cbe4e438c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.419159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2355e6a-5c21-4a51-b5fd-d9cbe4e438c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.419159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2355e6a-5c21-4a51-b5fd-d9cbe4e438c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.419159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2355e6a-5c21-4a51-b5fd-d9cbe4e438c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.443104 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c2355e6a-5c21-4a51-b5fd-d9cbe4e438c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9/ips" status: 200 len: 150 microversion: 2.1 time: 0.037570 Apr 12 14:57:40.447426 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 241/483] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Apr 12 14:57:40 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:40.454889 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5918a626-5ed9-42d0-988d-4bf54d50bb4d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f36cad5f-69c6-422b-80a6-5eb57db57451"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:40.456105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5918a626-5ed9-42d0-988d-4bf54d50bb4d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:40.463550 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5918a626-5ed9-42d0-988d-4bf54d50bb4d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.465155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5918a626-5ed9-42d0-988d-4bf54d50bb4d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.465155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5918a626-5ed9-42d0-988d-4bf54d50bb4d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.465155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5918a626-5ed9-42d0-988d-4bf54d50bb4d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.549003 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-5918a626-5ed9-42d0-988d-4bf54d50bb4d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Invalid volume: volume f36cad5f-69c6-422b-80a6-5eb57db57451 is already attached to instances: e2e10895-454d-437b-9325-591ccaa80da9 Apr 12 14:57:40.549620 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5918a626-5ed9-42d0-988d-4bf54d50bb4d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 400 to user: Invalid volume: volume f36cad5f-69c6-422b-80a6-5eb57db57451 is already attached to instances: e2e10895-454d-437b-9325-591ccaa80da9 {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:57:40.550486 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5918a626-5ed9-42d0-988d-4bf54d50bb4d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100052 Apr 12 14:57:40.551411 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 243/484] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 14:57:40 2022] POST /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 14:57:40.559717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fcb4938d-1dc4-4efc-8ba5-432aa7bcfa69 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:40.563002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fcb4938d-1dc4-4efc-8ba5-432aa7bcfa69 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:40.567088 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fcb4938d-1dc4-4efc-8ba5-432aa7bcfa69 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.567750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fcb4938d-1dc4-4efc-8ba5-432aa7bcfa69 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.568471 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a0785e6f-9ade-4a63-ae82-0f49d51f8a20 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:40.568771 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fcb4938d-1dc4-4efc-8ba5-432aa7bcfa69 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.569120 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a0785e6f-9ade-4a63-ae82-0f49d51f8a20 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:40.569731 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fcb4938d-1dc4-4efc-8ba5-432aa7bcfa69 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.577787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a0785e6f-9ade-4a63-ae82-0f49d51f8a20 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.580019 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a0785e6f-9ade-4a63-ae82-0f49d51f8a20 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.580019 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a0785e6f-9ade-4a63-ae82-0f49d51f8a20 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.580019 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a0785e6f-9ade-4a63-ae82-0f49d51f8a20 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.596461 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fcb4938d-1dc4-4efc-8ba5-432aa7bcfa69 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 14:57:40.715714 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a0785e6f-9ade-4a63-ae82-0f49d51f8a20 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:40.729119 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a0785e6f-9ade-4a63-ae82-0f49d51f8a20 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.164613 Apr 12 14:57:40.729372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 244/485] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:40 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:40.734124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-127d30e8-da61-4511-a6cb-e6a9adb213b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:40.734895 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-127d30e8-da61-4511-a6cb-e6a9adb213b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:40.740987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-127d30e8-da61-4511-a6cb-e6a9adb213b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.741431 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-127d30e8-da61-4511-a6cb-e6a9adb213b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.742348 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-127d30e8-da61-4511-a6cb-e6a9adb213b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.743383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-127d30e8-da61-4511-a6cb-e6a9adb213b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.889429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-127d30e8-da61-4511-a6cb-e6a9adb213b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:40.898150 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-127d30e8-da61-4511-a6cb-e6a9adb213b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:40.902258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-127d30e8-da61-4511-a6cb-e6a9adb213b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:40.902258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-127d30e8-da61-4511-a6cb-e6a9adb213b9 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1795 microversion: 2.20 time: 0.171073 Apr 12 14:57:40.902258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 245/486] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:57:40 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1795 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:57:40.969461 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fcb4938d-1dc4-4efc-8ba5-432aa7bcfa69 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 204 len: 0 microversion: 2.1 time: 0.413462 Apr 12 14:57:40.970108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 242/487] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 14:57:40 2022] DELETE /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 14:57:40.978677 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-38155ecf-b563-46ea-88a9-baec537b96b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:40.980122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-38155ecf-b563-46ea-88a9-baec537b96b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:40.986736 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-38155ecf-b563-46ea-88a9-baec537b96b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.987190 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-38155ecf-b563-46ea-88a9-baec537b96b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:40.988029 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-38155ecf-b563-46ea-88a9-baec537b96b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:40.988466 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-38155ecf-b563-46ea-88a9-baec537b96b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:41.129311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-38155ecf-b563-46ea-88a9-baec537b96b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:41.137448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-38155ecf-b563-46ea-88a9-baec537b96b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1681 microversion: 2.1 time: 0.162807 Apr 12 14:57:41.138262 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 246/488] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:40 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:41.747787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-577e97a2-4104-42ca-b7ab-900989075228 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:41.748173 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-577e97a2-4104-42ca-b7ab-900989075228 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:41.754427 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-577e97a2-4104-42ca-b7ab-900989075228 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:41.754876 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-577e97a2-4104-42ca-b7ab-900989075228 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:41.755653 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-577e97a2-4104-42ca-b7ab-900989075228 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:41.756084 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-577e97a2-4104-42ca-b7ab-900989075228 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:41.886274 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-577e97a2-4104-42ca-b7ab-900989075228 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:41.893728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-577e97a2-4104-42ca-b7ab-900989075228 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.151526 Apr 12 14:57:41.894293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 243/489] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:41 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:42.156939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-488bba1b-9cbd-4767-857f-18a711bc5861 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:42.157580 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-488bba1b-9cbd-4767-857f-18a711bc5861 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:42.164075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-488bba1b-9cbd-4767-857f-18a711bc5861 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:42.165037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-488bba1b-9cbd-4767-857f-18a711bc5861 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:42.166437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-488bba1b-9cbd-4767-857f-18a711bc5861 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:42.166724 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-488bba1b-9cbd-4767-857f-18a711bc5861 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:42.303187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-488bba1b-9cbd-4767-857f-18a711bc5861 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:42.311642 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-488bba1b-9cbd-4767-857f-18a711bc5861 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1681 microversion: 2.1 time: 0.159334 Apr 12 14:57:42.312249 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 247/490] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:42 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:42.911313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-efb62b45-7141-451d-8808-3a23897e8dd7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:42.911874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-efb62b45-7141-451d-8808-3a23897e8dd7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:42.918533 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efb62b45-7141-451d-8808-3a23897e8dd7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:42.919044 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efb62b45-7141-451d-8808-3a23897e8dd7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:42.919844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efb62b45-7141-451d-8808-3a23897e8dd7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:42.920264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efb62b45-7141-451d-8808-3a23897e8dd7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:43.061782 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-efb62b45-7141-451d-8808-3a23897e8dd7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:43.069423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-efb62b45-7141-451d-8808-3a23897e8dd7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.162117 Apr 12 14:57:43.070048 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 244/491] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:42 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:43.331451 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7773a914-b510-4eed-87ad-2643da7a0f13 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:43.332115 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7773a914-b510-4eed-87ad-2643da7a0f13 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:43.345203 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7773a914-b510-4eed-87ad-2643da7a0f13 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:43.346013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7773a914-b510-4eed-87ad-2643da7a0f13 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:43.347057 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7773a914-b510-4eed-87ad-2643da7a0f13 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:43.347653 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7773a914-b510-4eed-87ad-2643da7a0f13 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:43.417264 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7773a914-b510-4eed-87ad-2643da7a0f13 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:43.425788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7773a914-b510-4eed-87ad-2643da7a0f13 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1614 microversion: 2.1 time: 0.098925 Apr 12 14:57:43.428689 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 248/492] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:43 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:43.702807 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-bb01f532-5920-4900-be37-43d77a80e9cd req-2acb2e67-114d-433f-a3d6-4e0bfdcaa983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a709c0e8-54c5-43a2-a065-4ee9445449c9", "name": "network-vif-deleted", "tag": "d3c74b15-1916-4ae7-bef5-d2dee4e37164"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:43.714232 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-bb01f532-5920-4900-be37-43d77a80e9cd req-2acb2e67-114d-433f-a3d6-4e0bfdcaa983 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:43.714747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-bb01f532-5920-4900-be37-43d77a80e9cd req-2acb2e67-114d-433f-a3d6-4e0bfdcaa983 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:43.727307 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-bb01f532-5920-4900-be37-43d77a80e9cd req-2acb2e67-114d-433f-a3d6-4e0bfdcaa983 service nova] Creating event network-vif-deleted:d3c74b15-1916-4ae7-bef5-d2dee4e37164 for instance a709c0e8-54c5-43a2-a065-4ee9445449c9 on hv-cinder-83752 Apr 12 14:57:43.733079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-bb01f532-5920-4900-be37-43d77a80e9cd req-2acb2e67-114d-433f-a3d6-4e0bfdcaa983 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034031 Apr 12 14:57:43.734420 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 245/493] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:44.090534 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-05267021-59ba-423b-879f-ff27ad0f79d1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:44.096734 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-05267021-59ba-423b-879f-ff27ad0f79d1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:44.097449 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-05267021-59ba-423b-879f-ff27ad0f79d1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:44.097974 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-05267021-59ba-423b-879f-ff27ad0f79d1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:44.098742 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-05267021-59ba-423b-879f-ff27ad0f79d1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:44.099204 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-05267021-59ba-423b-879f-ff27ad0f79d1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:44.249073 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-05267021-59ba-423b-879f-ff27ad0f79d1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:44.257123 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-05267021-59ba-423b-879f-ff27ad0f79d1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1677 microversion: 2.1 time: 0.172237 Apr 12 14:57:44.268081 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 249/494] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:44 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:44.446015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:44.446778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:44.453555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:44.454039 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:44.454827 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:44.455262 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:44.489410 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:44.489893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:44.490371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lazy-loading 'fault' on Instance uuid a709c0e8-54c5-43a2-a065-4ee9445449c9 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:57:44.547036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:44.556142 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ba8c16fe-c3d8-4ef9-8b54-390c0e94d501 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 200 len: 1331 microversion: 2.1 time: 0.115290 Apr 12 14:57:44.560367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 246/495] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:44 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:45.274087 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f8a07224-e98f-4d09-9454-f07f77ed7e6c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:45.274697 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f8a07224-e98f-4d09-9454-f07f77ed7e6c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:45.281660 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f8a07224-e98f-4d09-9454-f07f77ed7e6c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:45.282106 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f8a07224-e98f-4d09-9454-f07f77ed7e6c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:45.283101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f8a07224-e98f-4d09-9454-f07f77ed7e6c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:45.283428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f8a07224-e98f-4d09-9454-f07f77ed7e6c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:45.426618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f8a07224-e98f-4d09-9454-f07f77ed7e6c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:45.435005 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f8a07224-e98f-4d09-9454-f07f77ed7e6c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1654 microversion: 2.1 time: 0.164691 Apr 12 14:57:45.435699 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 250/496] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:45 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1654 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:45.455057 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-53f678eb-a560-4938-baea-9438f5b98678 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:45.461996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53f678eb-a560-4938-baea-9438f5b98678 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:45.462537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53f678eb-a560-4938-baea-9438f5b98678 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:45.496540 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-53f678eb-a560-4938-baea-9438f5b98678 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Going to try to start instance {{(pid=124199) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 12 14:57:45.575208 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0df2348a-48f2-433c-bf26-79e063f6d0e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:45.576117 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0df2348a-48f2-433c-bf26-79e063f6d0e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:45.582445 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0df2348a-48f2-433c-bf26-79e063f6d0e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:45.582917 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0df2348a-48f2-433c-bf26-79e063f6d0e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:45.583722 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0df2348a-48f2-433c-bf26-79e063f6d0e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:45.597187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0df2348a-48f2-433c-bf26-79e063f6d0e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:45.599220 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-0df2348a-48f2-433c-bf26-79e063f6d0e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance a709c0e8-54c5-43a2-a065-4ee9445449c9 could not be found. Apr 12 14:57:45.599929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0df2348a-48f2-433c-bf26-79e063f6d0e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance a709c0e8-54c5-43a2-a065-4ee9445449c9 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:57:45.600962 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0df2348a-48f2-433c-bf26-79e063f6d0e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 404 len: 111 microversion: 2.1 time: 0.029794 Apr 12 14:57:45.602192 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 251/497] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:45 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 14:57:45.610676 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f1872ff9-0245-4fed-9b3d-1a07e029f05b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '.version_select at 0x7fbd609724c0>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:45.689743 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f1872ff9-0245-4fed-9b3d-1a07e029f05b tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437604112" status: 202 len: 0 microversion: 2.1 time: 0.082820 Apr 12 14:57:45.690546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 252/498] 10.222.0.64 () {58 vars in 1217 bytes} [Tue Apr 12 14:57:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437604112 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:57:45.760502 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-53f678eb-a560-4938-baea-9438f5b98678 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/action" status: 202 len: 0 microversion: 2.1 time: 0.309448 Apr 12 14:57:45.764340 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 247/499] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 14:57:45 2022] POST /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:57:45.771859 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0e4a8507-337b-403b-881f-2d48429fa068 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:45.772766 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0e4a8507-337b-403b-881f-2d48429fa068 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:45.780475 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0e4a8507-337b-403b-881f-2d48429fa068 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:45.781540 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0e4a8507-337b-403b-881f-2d48429fa068 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:45.782369 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0e4a8507-337b-403b-881f-2d48429fa068 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:45.782987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0e4a8507-337b-403b-881f-2d48429fa068 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:45.925034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0e4a8507-337b-403b-881f-2d48429fa068 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:45.933208 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0e4a8507-337b-403b-881f-2d48429fa068 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1663 microversion: 2.1 time: 0.167292 Apr 12 14:57:45.943380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 253/500] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:45 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:46.415014 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1470577903", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1413510922", "security_groups": [{"name": "tempest-secgroup-smoke-380384275"}], "networks": [{"uuid": "6fea4a05-44f3-4a63-902b-1de9a9ad79b4"}], "block_device_mapping_v2": [{"uuid": "757f401a-daeb-4475-abb4-4e3e0084a74b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:46.589079 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8fd837db-56ac-4b1d-a8fa-aae15cb5ac26 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:46.589742 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] validate_networks() for [('6fea4a05-44f3-4a63-902b-1de9a9ad79b4', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:57:46.591626 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8fd837db-56ac-4b1d-a8fa-aae15cb5ac26 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:46.613611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fd837db-56ac-4b1d-a8fa-aae15cb5ac26 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:46.614655 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fd837db-56ac-4b1d-a8fa-aae15cb5ac26 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:46.615465 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fd837db-56ac-4b1d-a8fa-aae15cb5ac26 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:46.615903 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fd837db-56ac-4b1d-a8fa-aae15cb5ac26 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:46.764273 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-8fd837db-56ac-4b1d-a8fa-aae15cb5ac26 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lazy-loading 'services' on Instance uuid e2e10895-454d-437b-9325-591ccaa80da9 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:57:46.999122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:57:46.999543 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:57:47.000018 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:57:47.000424 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:57:47.000833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:57:47.011155 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:47.011517 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:47.012315 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:47.012780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:47.021709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8fd837db-56ac-4b1d-a8fa-aae15cb5ac26 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-volume_attachments/f36cad5f-69c6-422b-80a6-5eb57db57451" status: 202 len: 0 microversion: 2.1 time: 0.446705 Apr 12 14:57:47.022467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 254/501] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Apr 12 14:57:46 2022] DELETE /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-volume_attachments/f36cad5f-69c6-422b-80a6-5eb57db57451 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:57:47.028510 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bdb015a1-6304-4db0-8f15-0d10f8d21e30 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:47.029390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bdb015a1-6304-4db0-8f15-0d10f8d21e30 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:47.033610 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Getting quotas for project ab3ab5283430466e9ab0b79750fc4e96. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:57:47.035500 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bdb015a1-6304-4db0-8f15-0d10f8d21e30 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:47.035950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bdb015a1-6304-4db0-8f15-0d10f8d21e30 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:47.036769 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bdb015a1-6304-4db0-8f15-0d10f8d21e30 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:47.037158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bdb015a1-6304-4db0-8f15-0d10f8d21e30 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:47.037885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Getting quotas for user 7b11e20132894393bdaf9b8fb4508ab8 and project ab3ab5283430466e9ab0b79750fc4e96. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:57:47.105610 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:57:47.108069 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='757f401a-daeb-4475-abb4-4e3e0084a74b',volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:57:47.187477 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bdb015a1-6304-4db0-8f15-0d10f8d21e30 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:47.197470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bdb015a1-6304-4db0-8f15-0d10f8d21e30 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1663 microversion: 2.1 time: 0.173383 Apr 12 14:57:47.209051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 255/502] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:47 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1663 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:47.209051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c6026b8e-57d0-438e-860c-3eaace3b37e9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:47.209051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c6026b8e-57d0-438e-860c-3eaace3b37e9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:47.214904 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6026b8e-57d0-438e-860c-3eaace3b37e9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:47.215387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6026b8e-57d0-438e-860c-3eaace3b37e9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:47.216186 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6026b8e-57d0-438e-860c-3eaace3b37e9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:47.216618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6026b8e-57d0-438e-860c-3eaace3b37e9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:47.249071 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c6026b8e-57d0-438e-860c-3eaace3b37e9 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049645 Apr 12 14:57:47.249653 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 256/503] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:57:47 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:47.537370 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5200b585-1ff9-42fe-87e9-cdc80b7aa327 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.126632 Apr 12 14:57:47.538075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 248/504] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:57:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:57:47.549143 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f9ee2e76-f61d-4943-a8df-8eba9927a6b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:47.549983 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f9ee2e76-f61d-4943-a8df-8eba9927a6b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:47.611480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f9ee2e76-f61d-4943-a8df-8eba9927a6b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:47.619529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f9ee2e76-f61d-4943-a8df-8eba9927a6b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1089 microversion: 2.1 time: 0.074290 Apr 12 14:57:47.620434 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 257/505] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:47 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:48.218054 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e97534f9-494e-409a-9818-8c0587cf2e99 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:48.218665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e97534f9-494e-409a-9818-8c0587cf2e99 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:48.225545 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e97534f9-494e-409a-9818-8c0587cf2e99 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:48.226086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e97534f9-494e-409a-9818-8c0587cf2e99 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:48.227521 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e97534f9-494e-409a-9818-8c0587cf2e99 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:48.227960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e97534f9-494e-409a-9818-8c0587cf2e99 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:48.274437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8d6f507c-16ff-4d8c-82ef-47fa0b67e109 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:48.274437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8d6f507c-16ff-4d8c-82ef-47fa0b67e109 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:48.279409 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d6f507c-16ff-4d8c-82ef-47fa0b67e109 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:48.280330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d6f507c-16ff-4d8c-82ef-47fa0b67e109 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:48.280966 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d6f507c-16ff-4d8c-82ef-47fa0b67e109 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:48.281521 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d6f507c-16ff-4d8c-82ef-47fa0b67e109 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:48.313199 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8d6f507c-16ff-4d8c-82ef-47fa0b67e109 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056607 Apr 12 14:57:48.314018 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 258/506] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:57:48 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:48.384478 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e97534f9-494e-409a-9818-8c0587cf2e99 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:48.392306 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e97534f9-494e-409a-9818-8c0587cf2e99 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1667 microversion: 2.1 time: 0.178261 Apr 12 14:57:48.394449 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 249/507] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:48 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1667 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:48.636377 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ce69a2d3-8227-4272-a19a-ad889b1a399e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:48.636992 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ce69a2d3-8227-4272-a19a-ad889b1a399e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:48.643519 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ce69a2d3-8227-4272-a19a-ad889b1a399e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:48.643962 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ce69a2d3-8227-4272-a19a-ad889b1a399e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:48.644754 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ce69a2d3-8227-4272-a19a-ad889b1a399e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:48.645187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ce69a2d3-8227-4272-a19a-ad889b1a399e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:48.711211 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ce69a2d3-8227-4272-a19a-ad889b1a399e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:48.719395 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ce69a2d3-8227-4272-a19a-ad889b1a399e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1139 microversion: 2.1 time: 0.086915 Apr 12 14:57:48.722305 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 259/508] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:48 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:49.326715 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7dfe000c-4896-4372-a06e-09d99bf1e425 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:49.327825 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7dfe000c-4896-4372-a06e-09d99bf1e425 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:49.333890 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7dfe000c-4896-4372-a06e-09d99bf1e425 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:49.334355 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7dfe000c-4896-4372-a06e-09d99bf1e425 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:49.335114 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7dfe000c-4896-4372-a06e-09d99bf1e425 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:49.335606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7dfe000c-4896-4372-a06e-09d99bf1e425 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:49.367179 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7dfe000c-4896-4372-a06e-09d99bf1e425 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045627 Apr 12 14:57:49.367760 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 250/509] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:57:49 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 14:57:49.431116 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8927f14e-c7ed-4368-a7eb-ec210867d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:49.431823 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8927f14e-c7ed-4368-a7eb-ec210867d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:49.438506 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8927f14e-c7ed-4368-a7eb-ec210867d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:49.438948 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8927f14e-c7ed-4368-a7eb-ec210867d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:49.439716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8927f14e-c7ed-4368-a7eb-ec210867d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:49.440142 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8927f14e-c7ed-4368-a7eb-ec210867d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:49.466100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8927f14e-c7ed-4368-a7eb-ec210867d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 14:57:49.738319 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-41a02d34-c283-488b-a77c-93b9891f1bbb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:49.738833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-41a02d34-c283-488b-a77c-93b9891f1bbb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:49.746128 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41a02d34-c283-488b-a77c-93b9891f1bbb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:49.746570 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41a02d34-c283-488b-a77c-93b9891f1bbb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:49.747332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41a02d34-c283-488b-a77c-93b9891f1bbb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:49.747756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-41a02d34-c283-488b-a77c-93b9891f1bbb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:49.814506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-41a02d34-c283-488b-a77c-93b9891f1bbb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:49.822172 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-41a02d34-c283-488b-a77c-93b9891f1bbb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1187 microversion: 2.1 time: 0.087808 Apr 12 14:57:49.822749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 251/510] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:49 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:49.825930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8927f14e-c7ed-4368-a7eb-ec210867d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 204 len: 0 microversion: 2.1 time: 0.399132 Apr 12 14:57:49.827066 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 260/511] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 14:57:49 2022] DELETE /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 14:57:49.835200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1f6a4d46-65b2-449d-a769-a09a4e1b98ea tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:49.835852 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1f6a4d46-65b2-449d-a769-a09a4e1b98ea tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:49.844201 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f6a4d46-65b2-449d-a769-a09a4e1b98ea tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:49.844728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f6a4d46-65b2-449d-a769-a09a4e1b98ea tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:49.845581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f6a4d46-65b2-449d-a769-a09a4e1b98ea tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:49.847530 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f6a4d46-65b2-449d-a769-a09a4e1b98ea tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:50.205065 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1f6a4d46-65b2-449d-a769-a09a4e1b98ea tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:50.213072 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1f6a4d46-65b2-449d-a769-a09a4e1b98ea tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1679 microversion: 2.1 time: 0.381684 Apr 12 14:57:50.213653 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 252/512] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:49 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1679 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:50.845332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f34baac0-7ade-4207-9e40-8c29de99de4b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:50.845973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f34baac0-7ade-4207-9e40-8c29de99de4b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:50.853189 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f34baac0-7ade-4207-9e40-8c29de99de4b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:50.853649 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f34baac0-7ade-4207-9e40-8c29de99de4b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:50.854447 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f34baac0-7ade-4207-9e40-8c29de99de4b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:50.854884 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f34baac0-7ade-4207-9e40-8c29de99de4b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:50.933141 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f34baac0-7ade-4207-9e40-8c29de99de4b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:50.941101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f34baac0-7ade-4207-9e40-8c29de99de4b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1195 microversion: 2.1 time: 0.100281 Apr 12 14:57:50.941696 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 261/513] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:50 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1195 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:51.237900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ac51a454-e390-4643-bf3f-76e8ab23f38d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:51.238723 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ac51a454-e390-4643-bf3f-76e8ab23f38d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:51.246270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac51a454-e390-4643-bf3f-76e8ab23f38d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:51.246711 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac51a454-e390-4643-bf3f-76e8ab23f38d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:51.247495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac51a454-e390-4643-bf3f-76e8ab23f38d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:51.247929 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac51a454-e390-4643-bf3f-76e8ab23f38d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:51.418360 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ac51a454-e390-4643-bf3f-76e8ab23f38d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:51.427065 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ac51a454-e390-4643-bf3f-76e8ab23f38d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1679 microversion: 2.1 time: 0.194817 Apr 12 14:57:51.432885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 253/514] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:51 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:51.962215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-79aabd9a-13b4-4ff3-b37f-5719a10ea04e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:51.962769 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-79aabd9a-13b4-4ff3-b37f-5719a10ea04e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:51.969123 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-79aabd9a-13b4-4ff3-b37f-5719a10ea04e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:51.969570 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-79aabd9a-13b4-4ff3-b37f-5719a10ea04e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:51.970365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-79aabd9a-13b4-4ff3-b37f-5719a10ea04e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:51.970797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-79aabd9a-13b4-4ff3-b37f-5719a10ea04e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:52.034335 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-79aabd9a-13b4-4ff3-b37f-5719a10ea04e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:52.042210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-79aabd9a-13b4-4ff3-b37f-5719a10ea04e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1205 microversion: 2.1 time: 0.084270 Apr 12 14:57:52.042777 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 262/515] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:51 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1205 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:52.451262 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e7e1cc33-df23-4758-91bd-f41ee234368f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:52.453036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e7e1cc33-df23-4758-91bd-f41ee234368f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:52.462895 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7e1cc33-df23-4758-91bd-f41ee234368f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:52.463644 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7e1cc33-df23-4758-91bd-f41ee234368f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:52.464932 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7e1cc33-df23-4758-91bd-f41ee234368f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:52.465555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7e1cc33-df23-4758-91bd-f41ee234368f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:52.621368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e7e1cc33-df23-4758-91bd-f41ee234368f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:52.629946 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e7e1cc33-df23-4758-91bd-f41ee234368f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1679 microversion: 2.1 time: 0.186089 Apr 12 14:57:52.631173 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 254/516] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:52 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:53.063495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1dbe3db5-20bb-41aa-97f6-eba95491330d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:53.064104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1dbe3db5-20bb-41aa-97f6-eba95491330d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:53.078225 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1dbe3db5-20bb-41aa-97f6-eba95491330d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:53.078708 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1dbe3db5-20bb-41aa-97f6-eba95491330d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:53.079563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1dbe3db5-20bb-41aa-97f6-eba95491330d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:53.080019 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1dbe3db5-20bb-41aa-97f6-eba95491330d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:53.235590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1dbe3db5-20bb-41aa-97f6-eba95491330d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:53.243962 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1dbe3db5-20bb-41aa-97f6-eba95491330d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.184518 Apr 12 14:57:53.244552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 263/517] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:53 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:53.415978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-21831cb3-f827-44cc-a1ee-63d2c8e21d93 req-8a12c6e0-1785-46a3-9e4e-e0901b6709c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e10895-454d-437b-9325-591ccaa80da9", "name": "network-vif-deleted", "tag": "83c56c7d-fadb-4e42-871f-2399e0153f94"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:53.425136 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-21831cb3-f827-44cc-a1ee-63d2c8e21d93 req-8a12c6e0-1785-46a3-9e4e-e0901b6709c3 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:53.427363 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-21831cb3-f827-44cc-a1ee-63d2c8e21d93 req-8a12c6e0-1785-46a3-9e4e-e0901b6709c3 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:53.439217 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-21831cb3-f827-44cc-a1ee-63d2c8e21d93 req-8a12c6e0-1785-46a3-9e4e-e0901b6709c3 service nova] Creating event network-vif-deleted:83c56c7d-fadb-4e42-871f-2399e0153f94 for instance e2e10895-454d-437b-9325-591ccaa80da9 on hv-cinder-83752 Apr 12 14:57:53.446348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-21831cb3-f827-44cc-a1ee-63d2c8e21d93 req-8a12c6e0-1785-46a3-9e4e-e0901b6709c3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033432 Apr 12 14:57:53.446686 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 255/518] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:53.648632 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-46e81c64-54f3-4252-affe-f61450da49f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:53.654489 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-46e81c64-54f3-4252-affe-f61450da49f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:53.667483 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-46e81c64-54f3-4252-affe-f61450da49f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:53.673690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-46e81c64-54f3-4252-affe-f61450da49f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:53.673690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-46e81c64-54f3-4252-affe-f61450da49f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:53.673690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-46e81c64-54f3-4252-affe-f61450da49f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:53.754942 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-46e81c64-54f3-4252-affe-f61450da49f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:53.765506 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-46e81c64-54f3-4252-affe-f61450da49f4 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 200 len: 1326 microversion: 2.1 time: 0.121122 Apr 12 14:57:53.766048 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 264/519] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:53 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 1326 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:54.263680 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fab588c7-bd18-4a1a-abac-30be7471a3f3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:54.264370 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fab588c7-bd18-4a1a-abac-30be7471a3f3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:54.270970 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fab588c7-bd18-4a1a-abac-30be7471a3f3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:54.271417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fab588c7-bd18-4a1a-abac-30be7471a3f3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:54.272185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fab588c7-bd18-4a1a-abac-30be7471a3f3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:54.272617 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fab588c7-bd18-4a1a-abac-30be7471a3f3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:54.426809 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fab588c7-bd18-4a1a-abac-30be7471a3f3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:54.437257 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fab588c7-bd18-4a1a-abac-30be7471a3f3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.178693 Apr 12 14:57:54.438159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 256/520] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:54 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:54.781986 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a0d0d1f4-885c-47a9-b0ad-1daf0c4a56fd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:54.782585 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a0d0d1f4-885c-47a9-b0ad-1daf0c4a56fd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:54.789380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a0d0d1f4-885c-47a9-b0ad-1daf0c4a56fd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:54.789854 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a0d0d1f4-885c-47a9-b0ad-1daf0c4a56fd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:54.790626 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a0d0d1f4-885c-47a9-b0ad-1daf0c4a56fd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:54.791066 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a0d0d1f4-885c-47a9-b0ad-1daf0c4a56fd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:54.803891 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-a0d0d1f4-885c-47a9-b0ad-1daf0c4a56fd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance e2e10895-454d-437b-9325-591ccaa80da9 could not be found. Apr 12 14:57:54.804522 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a0d0d1f4-885c-47a9-b0ad-1daf0c4a56fd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance e2e10895-454d-437b-9325-591ccaa80da9 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:57:54.805360 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a0d0d1f4-885c-47a9-b0ad-1daf0c4a56fd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 404 len: 111 microversion: 2.1 time: 0.027194 Apr 12 14:57:54.805924 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 265/521] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:54 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:57:54.814552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6dd659bc-70e1-4f7f-8846-1058e9690ec8 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '.version_select at 0x7fbd609bfa60>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:54.919010 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6dd659bc-70e1-4f7f-8846-1058e9690ec8 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442849917" status: 202 len: 0 microversion: 2.1 time: 0.108134 Apr 12 14:57:54.919542 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 257/522] 10.222.0.64 () {58 vars in 1220 bytes} [Tue Apr 12 14:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442849917 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:57:55.458274 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-995f8e5f-6bbd-4c00-a4ef-7dc4f53191a1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:55.459415 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-995f8e5f-6bbd-4c00-a4ef-7dc4f53191a1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:55.465840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-600d38e9-9334-4ca0-a9fc-d74c61244d43 req-1e856695-658e-4512-a674-c47d00367576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e688875-ca8d-4972-9d02-9c66a8634013", "tag": "1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:55.470323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-995f8e5f-6bbd-4c00-a4ef-7dc4f53191a1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:55.471370 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-995f8e5f-6bbd-4c00-a4ef-7dc4f53191a1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:55.472722 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-995f8e5f-6bbd-4c00-a4ef-7dc4f53191a1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:55.473505 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-995f8e5f-6bbd-4c00-a4ef-7dc4f53191a1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:55.475138 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-600d38e9-9334-4ca0-a9fc-d74c61244d43 req-1e856695-658e-4512-a674-c47d00367576 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:55.475580 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-600d38e9-9334-4ca0-a9fc-d74c61244d43 req-1e856695-658e-4512-a674-c47d00367576 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:55.486793 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-600d38e9-9334-4ca0-a9fc-d74c61244d43 req-1e856695-658e-4512-a674-c47d00367576 service nova] Creating event network-changed:1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe for instance 7e688875-ca8d-4972-9d02-9c66a8634013 on hv-cinder-83752 Apr 12 14:57:55.492508 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-600d38e9-9334-4ca0-a9fc-d74c61244d43 req-1e856695-658e-4512-a674-c47d00367576 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029734 Apr 12 14:57:55.492683 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 258/523] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:57:55.626181 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-995f8e5f-6bbd-4c00-a4ef-7dc4f53191a1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:55.633887 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-995f8e5f-6bbd-4c00-a4ef-7dc4f53191a1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.182921 Apr 12 14:57:55.634471 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 266/524] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:55 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:55.874069 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-47efa6d2-3ca7-4492-85fe-bf3129ca61db tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: .version_select at 0x7fbd608f04c0>, body: {"keypair": {"name": "tempest-keypair-69661964"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:55.888795 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-47efa6d2-3ca7-4492-85fe-bf3129ca61db tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:57:55.892925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-47efa6d2-3ca7-4492-85fe-bf3129ca61db tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:57:56.311185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-47efa6d2-3ca7-4492-85fe-bf3129ca61db tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:57:56.315211 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-47efa6d2-3ca7-4492-85fe-bf3129ca61db tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:57:56.329716 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-47efa6d2-3ca7-4492-85fe-bf3129ca61db tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.459778 Apr 12 14:57:56.330321 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 259/525] 10.222.0.64 () {60 vars in 1157 bytes} [Tue Apr 12 14:57:55 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:56.650787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a1c284b8-370c-45e2-a473-0b454364982d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:56.651401 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a1c284b8-370c-45e2-a473-0b454364982d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:56.657840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a1c284b8-370c-45e2-a473-0b454364982d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:56.658580 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a1c284b8-370c-45e2-a473-0b454364982d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:56.659111 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a1c284b8-370c-45e2-a473-0b454364982d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:56.659535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a1c284b8-370c-45e2-a473-0b454364982d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:56.796235 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a1c284b8-370c-45e2-a473-0b454364982d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:56.803813 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a1c284b8-370c-45e2-a473-0b454364982d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.156876 Apr 12 14:57:56.805877 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 267/526] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:56 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:57.774301 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0df7c6d4-1723-46a1-b17a-47ccd576a119 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41d810ab-a6f6-44c7-b504-cbdadfbf3aa9"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:57.776145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0df7c6d4-1723-46a1-b17a-47ccd576a119 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:57.782724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0df7c6d4-1723-46a1-b17a-47ccd576a119 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:57.783188 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0df7c6d4-1723-46a1-b17a-47ccd576a119 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:57.783971 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0df7c6d4-1723-46a1-b17a-47ccd576a119 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:57.784416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0df7c6d4-1723-46a1-b17a-47ccd576a119 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:57.825683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e81799fd-4feb-4cda-827b-f1fdfa88452a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:57.826341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e81799fd-4feb-4cda-827b-f1fdfa88452a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:57.832753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e81799fd-4feb-4cda-827b-f1fdfa88452a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:57.833201 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e81799fd-4feb-4cda-827b-f1fdfa88452a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:57.834018 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e81799fd-4feb-4cda-827b-f1fdfa88452a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:57.834463 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e81799fd-4feb-4cda-827b-f1fdfa88452a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:57.982684 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e81799fd-4feb-4cda-827b-f1fdfa88452a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:57.991092 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e81799fd-4feb-4cda-827b-f1fdfa88452a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.169778 Apr 12 14:57:57.993273 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 268/527] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:57 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:57:58.625280 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0df7c6d4-1723-46a1-b17a-47ccd576a119 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856150 Apr 12 14:57:58.626167 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 260/528] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 14:57:57 2022] POST /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:57:58.659727 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-882435", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc73a003-4067-4844-9c4d-7187574c0c62"}], "security_groups": [{"name": "tempest-securitygroup--1460304101"}], "key_name": "tempest-keypair-69661964", "user_data": "}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:57:58.772247 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] validate_networks() for [('bc73a003-4067-4844-9c4d-7187574c0c62', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:57:59.011226 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0ea97350-7738-4799-a9b9-0e1b3547b6ae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:59.011961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0ea97350-7738-4799-a9b9-0e1b3547b6ae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:59.018354 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0ea97350-7738-4799-a9b9-0e1b3547b6ae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:59.018798 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0ea97350-7738-4799-a9b9-0e1b3547b6ae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:59.019708 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0ea97350-7738-4799-a9b9-0e1b3547b6ae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:59.020149 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0ea97350-7738-4799-a9b9-0e1b3547b6ae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:59.237499 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0ea97350-7738-4799-a9b9-0e1b3547b6ae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:59.246605 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0ea97350-7738-4799-a9b9-0e1b3547b6ae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.240349 Apr 12 14:57:59.247192 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 261/529] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:59 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:57:59.256952 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:57:59.258655 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:57:59.259252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:57:59.259669 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:57:59.260071 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:57:59.268788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:59.269314 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:59.270142 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:57:59.270569 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:57:59.289417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:57:59.293665 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:57:59.306928 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:57:59.309188 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:57:59.494364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e3ef807e-7068-44b9-92b4-ff84224d3ada tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.838887 Apr 12 14:57:59.495005 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 269/530] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:57:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 12 14:57:59.505434 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7a96e1ce-900e-4ae9-97b6-1b2c3c103db0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:57:59.506067 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7a96e1ce-900e-4ae9-97b6-1b2c3c103db0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:57:59.560933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7a96e1ce-900e-4ae9-97b6-1b2c3c103db0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:57:59.567678 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7a96e1ce-900e-4ae9-97b6-1b2c3c103db0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1236 microversion: 2.1 time: 0.066429 Apr 12 14:57:59.568255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 262/531] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:57:59 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:00.264688 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9b73c8ef-79f4-4b07-b362-247a160e4b12 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:00.265236 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9b73c8ef-79f4-4b07-b362-247a160e4b12 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:00.271365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b73c8ef-79f4-4b07-b362-247a160e4b12 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:00.271814 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b73c8ef-79f4-4b07-b362-247a160e4b12 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:00.272613 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b73c8ef-79f4-4b07-b362-247a160e4b12 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:00.273046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b73c8ef-79f4-4b07-b362-247a160e4b12 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:00.408660 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9b73c8ef-79f4-4b07-b362-247a160e4b12 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:00.416679 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9b73c8ef-79f4-4b07-b362-247a160e4b12 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.156508 Apr 12 14:58:00.417445 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 270/532] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:00 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:00.586002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1921c2a3-b601-4b70-97ef-39f01bea2748 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:00.592961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1921c2a3-b601-4b70-97ef-39f01bea2748 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:00.593779 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1921c2a3-b601-4b70-97ef-39f01bea2748 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:00.594226 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1921c2a3-b601-4b70-97ef-39f01bea2748 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:00.595007 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1921c2a3-b601-4b70-97ef-39f01bea2748 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:00.595439 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1921c2a3-b601-4b70-97ef-39f01bea2748 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:00.659328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1921c2a3-b601-4b70-97ef-39f01bea2748 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:00.667687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1921c2a3-b601-4b70-97ef-39f01bea2748 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1240 microversion: 2.1 time: 0.085553 Apr 12 14:58:00.668271 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 263/533] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:00 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:01.434998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e4c111c6-5bac-4127-9fff-aeba460bed48 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:01.435530 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e4c111c6-5bac-4127-9fff-aeba460bed48 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:01.441891 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4c111c6-5bac-4127-9fff-aeba460bed48 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:01.442332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4c111c6-5bac-4127-9fff-aeba460bed48 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:01.443087 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4c111c6-5bac-4127-9fff-aeba460bed48 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:01.443699 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4c111c6-5bac-4127-9fff-aeba460bed48 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:01.579950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e4c111c6-5bac-4127-9fff-aeba460bed48 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:01.587886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e4c111c6-5bac-4127-9fff-aeba460bed48 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.157052 Apr 12 14:58:01.588459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 271/534] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:01 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:01.685588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1233442d-86d5-4146-9cf2-3140c90dca80 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:01.686135 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1233442d-86d5-4146-9cf2-3140c90dca80 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:01.692474 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1233442d-86d5-4146-9cf2-3140c90dca80 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:01.692922 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1233442d-86d5-4146-9cf2-3140c90dca80 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:01.693713 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1233442d-86d5-4146-9cf2-3140c90dca80 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:01.694152 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1233442d-86d5-4146-9cf2-3140c90dca80 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:01.755780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1233442d-86d5-4146-9cf2-3140c90dca80 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:01.763910 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1233442d-86d5-4146-9cf2-3140c90dca80 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1288 microversion: 2.1 time: 0.082358 Apr 12 14:58:01.764488 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 264/535] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:01 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:02.605271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e69885c4-b588-4965-ba0e-46c2ef26b7f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:02.606480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e69885c4-b588-4965-ba0e-46c2ef26b7f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:02.613077 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e69885c4-b588-4965-ba0e-46c2ef26b7f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:02.613526 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e69885c4-b588-4965-ba0e-46c2ef26b7f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:02.614342 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e69885c4-b588-4965-ba0e-46c2ef26b7f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:02.614779 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e69885c4-b588-4965-ba0e-46c2ef26b7f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:02.780823 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-53ef952d-8aa1-4750-a7e5-04ee0b6cfd22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:02.781445 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-53ef952d-8aa1-4750-a7e5-04ee0b6cfd22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:02.789363 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53ef952d-8aa1-4750-a7e5-04ee0b6cfd22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:02.790473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53ef952d-8aa1-4750-a7e5-04ee0b6cfd22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:02.790650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e69885c4-b588-4965-ba0e-46c2ef26b7f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:02.791479 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53ef952d-8aa1-4750-a7e5-04ee0b6cfd22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:02.791899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-53ef952d-8aa1-4750-a7e5-04ee0b6cfd22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:02.800728 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e69885c4-b588-4965-ba0e-46c2ef26b7f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.199374 Apr 12 14:58:02.802101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 272/536] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:02 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:02.983280 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-53ef952d-8aa1-4750-a7e5-04ee0b6cfd22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:02.997284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-53ef952d-8aa1-4750-a7e5-04ee0b6cfd22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1362 microversion: 2.1 time: 0.220598 Apr 12 14:58:02.997915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 265/537] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:02 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:03.664311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-dbd3f427-0fd1-4a4b-82c9-e699cf50393a req-2b8c0391-a679-4439-9e0c-d2c819408e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae131a2b-c453-4c6c-b640-61daffe8c005", "tag": "0234a853-b13d-45b5-b98f-e584074a2235"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:03.674829 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-dbd3f427-0fd1-4a4b-82c9-e699cf50393a req-2b8c0391-a679-4439-9e0c-d2c819408e96 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:03.675273 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-dbd3f427-0fd1-4a4b-82c9-e699cf50393a req-2b8c0391-a679-4439-9e0c-d2c819408e96 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:03.695200 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-dbd3f427-0fd1-4a4b-82c9-e699cf50393a req-2b8c0391-a679-4439-9e0c-d2c819408e96 service nova] Creating event network-changed:0234a853-b13d-45b5-b98f-e584074a2235 for instance ae131a2b-c453-4c6c-b640-61daffe8c005 on hv-cinder-83752 Apr 12 14:58:03.700284 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-dbd3f427-0fd1-4a4b-82c9-e699cf50393a req-2b8c0391-a679-4439-9e0c-d2c819408e96 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039456 Apr 12 14:58:03.700900 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 273/538] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:03.818472 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bf379668-4f40-42f6-8da1-c7ed6a4bcf3a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:03.819093 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bf379668-4f40-42f6-8da1-c7ed6a4bcf3a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:03.826719 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf379668-4f40-42f6-8da1-c7ed6a4bcf3a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:03.827165 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf379668-4f40-42f6-8da1-c7ed6a4bcf3a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:03.827941 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf379668-4f40-42f6-8da1-c7ed6a4bcf3a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:03.828369 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf379668-4f40-42f6-8da1-c7ed6a4bcf3a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:04.001289 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bf379668-4f40-42f6-8da1-c7ed6a4bcf3a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:04.009978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bf379668-4f40-42f6-8da1-c7ed6a4bcf3a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.195232 Apr 12 14:58:04.010591 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 266/539] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:03 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:04.015616 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3a7f8919-d251-4446-b63f-b2089b104599 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:04.016335 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3a7f8919-d251-4446-b63f-b2089b104599 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:04.023229 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a7f8919-d251-4446-b63f-b2089b104599 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:04.023828 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a7f8919-d251-4446-b63f-b2089b104599 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:04.024615 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a7f8919-d251-4446-b63f-b2089b104599 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:04.025043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a7f8919-d251-4446-b63f-b2089b104599 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:04.161415 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3a7f8919-d251-4446-b63f-b2089b104599 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:04.169459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3a7f8919-d251-4446-b63f-b2089b104599 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1362 microversion: 2.1 time: 0.158659 Apr 12 14:58:04.170086 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 274/540] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:04 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:05.016981 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-9c8df1b3-40a9-4854-880b-dd2df101ca9f req-d674e522-3df6-4d9c-8080-5a175ba0af72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e688875-ca8d-4972-9d02-9c66a8634013", "name": "network-vif-plugged", "status": "completed", "tag": "1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:05.030930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-9c8df1b3-40a9-4854-880b-dd2df101ca9f req-d674e522-3df6-4d9c-8080-5a175ba0af72 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:05.031520 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-9c8df1b3-40a9-4854-880b-dd2df101ca9f req-d674e522-3df6-4d9c-8080-5a175ba0af72 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:05.033884 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5ff5f9db-6dba-4b31-822c-54175e5a54d6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:05.042726 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5ff5f9db-6dba-4b31-822c-54175e5a54d6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:05.042726 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ff5f9db-6dba-4b31-822c-54175e5a54d6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:05.043407 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ff5f9db-6dba-4b31-822c-54175e5a54d6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:05.044461 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ff5f9db-6dba-4b31-822c-54175e5a54d6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:05.044573 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-9c8df1b3-40a9-4854-880b-dd2df101ca9f req-d674e522-3df6-4d9c-8080-5a175ba0af72 service nova] Creating event network-vif-plugged:1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe for instance 7e688875-ca8d-4972-9d02-9c66a8634013 on hv-cinder-83752 Apr 12 14:58:05.044980 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ff5f9db-6dba-4b31-822c-54175e5a54d6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:05.051097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-9c8df1b3-40a9-4854-880b-dd2df101ca9f req-d674e522-3df6-4d9c-8080-5a175ba0af72 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036915 Apr 12 14:58:05.051097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 267/541] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:05.187306 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-be432e13-382d-4047-8f64-3e9fa75408bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:05.188270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-be432e13-382d-4047-8f64-3e9fa75408bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:05.189590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5ff5f9db-6dba-4b31-822c-54175e5a54d6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:05.195290 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be432e13-382d-4047-8f64-3e9fa75408bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:05.195765 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be432e13-382d-4047-8f64-3e9fa75408bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:05.196519 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be432e13-382d-4047-8f64-3e9fa75408bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:05.196952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be432e13-382d-4047-8f64-3e9fa75408bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:05.198466 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5ff5f9db-6dba-4b31-822c-54175e5a54d6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.170856 Apr 12 14:58:05.199049 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 275/542] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:05 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:05.331703 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-be432e13-382d-4047-8f64-3e9fa75408bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:05.339640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-be432e13-382d-4047-8f64-3e9fa75408bb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1362 microversion: 2.1 time: 0.156647 Apr 12 14:58:05.340227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 268/543] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:05 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:06.216999 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b0d19904-0c6a-4b83-be75-5bd0270eafde tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:06.217801 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b0d19904-0c6a-4b83-be75-5bd0270eafde tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:06.225063 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0d19904-0c6a-4b83-be75-5bd0270eafde tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:06.227167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0d19904-0c6a-4b83-be75-5bd0270eafde tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:06.228004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0d19904-0c6a-4b83-be75-5bd0270eafde tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:06.228467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0d19904-0c6a-4b83-be75-5bd0270eafde tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:06.356590 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-36624325-46f1-421c-8cc4-36384359fdbf tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:06.357196 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-36624325-46f1-421c-8cc4-36384359fdbf tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:06.363786 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-36624325-46f1-421c-8cc4-36384359fdbf tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:06.364248 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-36624325-46f1-421c-8cc4-36384359fdbf tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:06.365033 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-36624325-46f1-421c-8cc4-36384359fdbf tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:06.365464 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-36624325-46f1-421c-8cc4-36384359fdbf tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:06.374213 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b0d19904-0c6a-4b83-be75-5bd0270eafde tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:06.384371 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b0d19904-0c6a-4b83-be75-5bd0270eafde tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.171643 Apr 12 14:58:06.384886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 276/544] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:06 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:06.508483 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-36624325-46f1-421c-8cc4-36384359fdbf tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:06.515989 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-36624325-46f1-421c-8cc4-36384359fdbf tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1362 microversion: 2.1 time: 0.163305 Apr 12 14:58:06.516555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 269/545] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:06 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:07.246792 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d5c7ab13-85c0-4675-bd26-e360a7982708 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:07.246792 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d5c7ab13-85c0-4675-bd26-e360a7982708 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:07.254936 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5c7ab13-85c0-4675-bd26-e360a7982708 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:07.255385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5c7ab13-85c0-4675-bd26-e360a7982708 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:07.256158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5c7ab13-85c0-4675-bd26-e360a7982708 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:07.256587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5c7ab13-85c0-4675-bd26-e360a7982708 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:07.280067 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-d5c7ab13-85c0-4675-bd26-e360a7982708 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lazy-loading 'flavor' on Instance uuid dfd692aa-e03c-4686-8512-e5b6d426893f {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:58:07.400469 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-75339da0-2897-4394-8cec-5423b9440217 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:07.401127 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-75339da0-2897-4394-8cec-5423b9440217 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:07.407587 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75339da0-2897-4394-8cec-5423b9440217 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:07.412477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75339da0-2897-4394-8cec-5423b9440217 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:07.412477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75339da0-2897-4394-8cec-5423b9440217 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:07.412477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75339da0-2897-4394-8cec-5423b9440217 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:07.541734 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d5c7ab13-85c0-4675-bd26-e360a7982708 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/action" status: 200 len: 32 microversion: 2.1 time: 0.301591 Apr 12 14:58:07.543037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 277/546] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 14:58:07 2022] POST /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 14:58:07.552739 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-75339da0-2897-4394-8cec-5423b9440217 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:07.552898 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f54a6b4b-c6f6-43b0-8ccf-850393b9bedc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:07.553597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f54a6b4b-c6f6-43b0-8ccf-850393b9bedc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:07.560329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f54a6b4b-c6f6-43b0-8ccf-850393b9bedc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:07.560603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-75339da0-2897-4394-8cec-5423b9440217 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1260 microversion: 2.1 time: 0.164008 Apr 12 14:58:07.560969 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f54a6b4b-c6f6-43b0-8ccf-850393b9bedc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:07.561088 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 270/547] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:07 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:07.561946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f54a6b4b-c6f6-43b0-8ccf-850393b9bedc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:07.562389 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f54a6b4b-c6f6-43b0-8ccf-850393b9bedc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:07.567845 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3c771a5d-8f26-437b-9948-c714b8d272a9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:07.574147 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3c771a5d-8f26-437b-9948-c714b8d272a9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:07.581613 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c771a5d-8f26-437b-9948-c714b8d272a9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:07.582211 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c771a5d-8f26-437b-9948-c714b8d272a9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:07.583093 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c771a5d-8f26-437b-9948-c714b8d272a9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:07.583525 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c771a5d-8f26-437b-9948-c714b8d272a9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:07.752081 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f54a6b4b-c6f6-43b0-8ccf-850393b9bedc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:07.760970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f54a6b4b-c6f6-43b0-8ccf-850393b9bedc tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1362 microversion: 2.1 time: 0.212348 Apr 12 14:58:07.761652 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 278/548] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:07 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:07.785135 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3c771a5d-8f26-437b-9948-c714b8d272a9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:07.795728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3c771a5d-8f26-437b-9948-c714b8d272a9 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.230826 Apr 12 14:58:07.795728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 271/549] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:07 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:08.583763 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2419c766-fe14-4b49-ae03-13ae26c7c9f8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:08.584288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2419c766-fe14-4b49-ae03-13ae26c7c9f8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:08.590716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2419c766-fe14-4b49-ae03-13ae26c7c9f8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:08.591160 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2419c766-fe14-4b49-ae03-13ae26c7c9f8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:08.601075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2419c766-fe14-4b49-ae03-13ae26c7c9f8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:08.601606 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2419c766-fe14-4b49-ae03-13ae26c7c9f8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:08.751829 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2419c766-fe14-4b49-ae03-13ae26c7c9f8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:08.759822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2419c766-fe14-4b49-ae03-13ae26c7c9f8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1444 microversion: 2.1 time: 0.180766 Apr 12 14:58:08.760404 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 279/550] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:08 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1444 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:08.779289 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-50f776fd-fc69-44be-8744-ef5c8fc1c7ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:08.780181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-50f776fd-fc69-44be-8744-ef5c8fc1c7ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:08.789067 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50f776fd-fc69-44be-8744-ef5c8fc1c7ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:08.789855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50f776fd-fc69-44be-8744-ef5c8fc1c7ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:08.790632 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50f776fd-fc69-44be-8744-ef5c8fc1c7ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:08.791197 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50f776fd-fc69-44be-8744-ef5c8fc1c7ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:08.799271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-88f0fd78-abf1-4053-83b0-a8517add05c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:08.799987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-88f0fd78-abf1-4053-83b0-a8517add05c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:08.815326 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88f0fd78-abf1-4053-83b0-a8517add05c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:08.816128 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88f0fd78-abf1-4053-83b0-a8517add05c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:08.817280 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88f0fd78-abf1-4053-83b0-a8517add05c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:08.817965 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88f0fd78-abf1-4053-83b0-a8517add05c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:09.009581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-50f776fd-fc69-44be-8744-ef5c8fc1c7ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:09.017458 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-88f0fd78-abf1-4053-83b0-a8517add05c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:09.018158 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-50f776fd-fc69-44be-8744-ef5c8fc1c7ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1444 microversion: 2.1 time: 0.242943 Apr 12 14:58:09.019111 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 272/551] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:08 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1444 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:09.025337 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d5da2190-5c31-4264-82c7-7233f4e9e3a3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:09.027274 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d5da2190-5c31-4264-82c7-7233f4e9e3a3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:09.031656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-88f0fd78-abf1-4053-83b0-a8517add05c1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1362 microversion: 2.1 time: 0.245524 Apr 12 14:58:09.033492 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 280/552] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:08 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:09.037846 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5da2190-5c31-4264-82c7-7233f4e9e3a3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:09.038897 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5da2190-5c31-4264-82c7-7233f4e9e3a3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:09.039863 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5da2190-5c31-4264-82c7-7233f4e9e3a3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:09.040148 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-4c9b72c8-e1b4-498f-9cac-f3546cddaaf7 req-a03983dc-873b-4285-a98c-c0e7ea3413a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae131a2b-c453-4c6c-b640-61daffe8c005", "name": "network-vif-plugged", "status": "completed", "tag": "0234a853-b13d-45b5-b98f-e584074a2235"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:09.040665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5da2190-5c31-4264-82c7-7233f4e9e3a3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:09.050661 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-4c9b72c8-e1b4-498f-9cac-f3546cddaaf7 req-a03983dc-873b-4285-a98c-c0e7ea3413a4 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:09.051318 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-4c9b72c8-e1b4-498f-9cac-f3546cddaaf7 req-a03983dc-873b-4285-a98c-c0e7ea3413a4 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:09.067163 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-4c9b72c8-e1b4-498f-9cac-f3546cddaaf7 req-a03983dc-873b-4285-a98c-c0e7ea3413a4 service nova] Creating event network-vif-plugged:0234a853-b13d-45b5-b98f-e584074a2235 for instance ae131a2b-c453-4c6c-b640-61daffe8c005 on hv-cinder-83752 Apr 12 14:58:09.072636 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-4c9b72c8-e1b4-498f-9cac-f3546cddaaf7 req-a03983dc-873b-4285-a98c-c0e7ea3413a4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037694 Apr 12 14:58:09.073866 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 281/553] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:09.195852 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d5da2190-5c31-4264-82c7-7233f4e9e3a3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:09.204634 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d5da2190-5c31-4264-82c7-7233f4e9e3a3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.184072 Apr 12 14:58:09.205220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 273/554] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:09 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:10.051529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-42688056-30e1-4255-830a-9e648160e303 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:10.052216 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-42688056-30e1-4255-830a-9e648160e303 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:10.059171 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42688056-30e1-4255-830a-9e648160e303 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:10.059613 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42688056-30e1-4255-830a-9e648160e303 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:10.060385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42688056-30e1-4255-830a-9e648160e303 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:10.060811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42688056-30e1-4255-830a-9e648160e303 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:10.202245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-42688056-30e1-4255-830a-9e648160e303 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:10.210560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-42688056-30e1-4255-830a-9e648160e303 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1362 microversion: 2.1 time: 0.162523 Apr 12 14:58:10.211650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 282/555] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:10 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:10.222544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b0567219-4005-49f9-b636-00dbab2511ec tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:10.224025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b0567219-4005-49f9-b636-00dbab2511ec tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:10.229897 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b0567219-4005-49f9-b636-00dbab2511ec tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:10.230347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b0567219-4005-49f9-b636-00dbab2511ec tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:10.231120 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b0567219-4005-49f9-b636-00dbab2511ec tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:10.231553 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b0567219-4005-49f9-b636-00dbab2511ec tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:10.372898 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b0567219-4005-49f9-b636-00dbab2511ec tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:10.380886 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b0567219-4005-49f9-b636-00dbab2511ec tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.162120 Apr 12 14:58:10.381471 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 274/556] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:10 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:11.229254 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-80740943-2e0c-445e-acea-956c16ff657c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:11.230148 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-80740943-2e0c-445e-acea-956c16ff657c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:11.237942 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80740943-2e0c-445e-acea-956c16ff657c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:11.238383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80740943-2e0c-445e-acea-956c16ff657c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:11.239152 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80740943-2e0c-445e-acea-956c16ff657c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:11.239639 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80740943-2e0c-445e-acea-956c16ff657c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:11.380935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-80740943-2e0c-445e-acea-956c16ff657c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:11.389258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-80740943-2e0c-445e-acea-956c16ff657c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1362 microversion: 2.1 time: 0.164381 Apr 12 14:58:11.390105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 283/557] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:11 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:11.398838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77eb5b2a-e91c-45e4-ba40-842386175b6d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:11.399660 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-77eb5b2a-e91c-45e4-ba40-842386175b6d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:11.407659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77eb5b2a-e91c-45e4-ba40-842386175b6d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:11.408113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77eb5b2a-e91c-45e4-ba40-842386175b6d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:11.408899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77eb5b2a-e91c-45e4-ba40-842386175b6d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:11.409330 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77eb5b2a-e91c-45e4-ba40-842386175b6d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:11.555333 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-77eb5b2a-e91c-45e4-ba40-842386175b6d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:11.563869 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-77eb5b2a-e91c-45e4-ba40-842386175b6d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.169045 Apr 12 14:58:11.571696 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 275/558] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:11 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:11.970134 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-67538d85-771f-4a05-a8da-ed88af5ed243 req-438d69ad-0293-4db6-934d-819674863882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e688875-ca8d-4972-9d02-9c66a8634013", "tag": "1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:11.979800 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-67538d85-771f-4a05-a8da-ed88af5ed243 req-438d69ad-0293-4db6-934d-819674863882 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:11.980234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-67538d85-771f-4a05-a8da-ed88af5ed243 req-438d69ad-0293-4db6-934d-819674863882 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:11.990646 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-67538d85-771f-4a05-a8da-ed88af5ed243 req-438d69ad-0293-4db6-934d-819674863882 service nova] Creating event network-changed:1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe for instance 7e688875-ca8d-4972-9d02-9c66a8634013 on hv-cinder-83752 Apr 12 14:58:11.996125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-67538d85-771f-4a05-a8da-ed88af5ed243 req-438d69ad-0293-4db6-934d-819674863882 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029597 Apr 12 14:58:11.997123 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 284/559] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:12.410089 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cf8d4b40-db1c-42e3-8023-759097de5a22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:12.411348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cf8d4b40-db1c-42e3-8023-759097de5a22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:12.420602 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf8d4b40-db1c-42e3-8023-759097de5a22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:12.421046 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf8d4b40-db1c-42e3-8023-759097de5a22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:12.421938 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf8d4b40-db1c-42e3-8023-759097de5a22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:12.422371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cf8d4b40-db1c-42e3-8023-759097de5a22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:12.573933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cf8d4b40-db1c-42e3-8023-759097de5a22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:12.582658 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c6a573e1-644d-41a6-ab13-ccc590fbb539 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:12.583659 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c6a573e1-644d-41a6-ab13-ccc590fbb539 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:12.595969 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cf8d4b40-db1c-42e3-8023-759097de5a22 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1551 microversion: 2.1 time: 0.193247 Apr 12 14:58:12.598827 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6a573e1-644d-41a6-ab13-ccc590fbb539 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:12.599842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6a573e1-644d-41a6-ab13-ccc590fbb539 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:12.601203 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6a573e1-644d-41a6-ab13-ccc590fbb539 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:12.601989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6a573e1-644d-41a6-ab13-ccc590fbb539 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:12.606394 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 276/560] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:12 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1551 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:12.613090 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0320da19-4bfa-4115-8eee-f2a49c5a024e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:12.613923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0320da19-4bfa-4115-8eee-f2a49c5a024e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:12.621850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0320da19-4bfa-4115-8eee-f2a49c5a024e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:12.622629 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0320da19-4bfa-4115-8eee-f2a49c5a024e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:12.623568 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0320da19-4bfa-4115-8eee-f2a49c5a024e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:12.624056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0320da19-4bfa-4115-8eee-f2a49c5a024e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:12.746372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0320da19-4bfa-4115-8eee-f2a49c5a024e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136831 Apr 12 14:58:12.749365 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 277/561] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Apr 12 14:58:12 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:12.793977 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c6a573e1-644d-41a6-ab13-ccc590fbb539 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:12.802599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c6a573e1-644d-41a6-ab13-ccc590fbb539 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.224816 Apr 12 14:58:12.803198 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 285/562] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:12 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:13.821617 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4bf759a3-4e0f-421b-a58c-7f9e52a8a8a8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:13.822319 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4bf759a3-4e0f-421b-a58c-7f9e52a8a8a8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:13.828461 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4bf759a3-4e0f-421b-a58c-7f9e52a8a8a8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:13.828928 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4bf759a3-4e0f-421b-a58c-7f9e52a8a8a8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:13.829712 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4bf759a3-4e0f-421b-a58c-7f9e52a8a8a8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:13.830176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4bf759a3-4e0f-421b-a58c-7f9e52a8a8a8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:13.964298 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4bf759a3-4e0f-421b-a58c-7f9e52a8a8a8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:13.972281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4bf759a3-4e0f-421b-a58c-7f9e52a8a8a8 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.155742 Apr 12 14:58:13.972930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 278/563] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:13 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:14.155357 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-c283e96c-083e-4f12-be49-fd99efb7e807 req-f52d1714-945a-453b-9ce3-2736c72dda9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae131a2b-c453-4c6c-b640-61daffe8c005", "tag": "0234a853-b13d-45b5-b98f-e584074a2235"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:14.166639 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-c283e96c-083e-4f12-be49-fd99efb7e807 req-f52d1714-945a-453b-9ce3-2736c72dda9e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:14.167094 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-c283e96c-083e-4f12-be49-fd99efb7e807 req-f52d1714-945a-453b-9ce3-2736c72dda9e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:14.179711 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-c283e96c-083e-4f12-be49-fd99efb7e807 req-f52d1714-945a-453b-9ce3-2736c72dda9e service nova] Creating event network-changed:0234a853-b13d-45b5-b98f-e584074a2235 for instance ae131a2b-c453-4c6c-b640-61daffe8c005 on hv-cinder-83752 Apr 12 14:58:14.185028 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-c283e96c-083e-4f12-be49-fd99efb7e807 req-f52d1714-945a-453b-9ce3-2736c72dda9e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033848 Apr 12 14:58:14.185817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 286/564] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:14.990773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d933a680-05d0-4003-a9a5-117670d82e99 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:14.991925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d933a680-05d0-4003-a9a5-117670d82e99 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:14.998451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d933a680-05d0-4003-a9a5-117670d82e99 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:14.998904 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d933a680-05d0-4003-a9a5-117670d82e99 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:14.999687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d933a680-05d0-4003-a9a5-117670d82e99 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:15.000126 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d933a680-05d0-4003-a9a5-117670d82e99 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:15.138025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d933a680-05d0-4003-a9a5-117670d82e99 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:15.146423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d933a680-05d0-4003-a9a5-117670d82e99 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.159444 Apr 12 14:58:15.152532 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 279/565] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:14 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:16.166480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-89b017ae-302a-41a0-be5e-87f47b89065b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:16.167180 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-89b017ae-302a-41a0-be5e-87f47b89065b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:16.173525 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89b017ae-302a-41a0-be5e-87f47b89065b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:16.174038 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89b017ae-302a-41a0-be5e-87f47b89065b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:16.174825 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89b017ae-302a-41a0-be5e-87f47b89065b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:16.175289 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89b017ae-302a-41a0-be5e-87f47b89065b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:16.311917 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-89b017ae-302a-41a0-be5e-87f47b89065b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:16.320700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-89b017ae-302a-41a0-be5e-87f47b89065b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.158857 Apr 12 14:58:16.321282 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 287/566] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:16 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:17.340577 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-87becb2b-8cdf-4cee-9206-e395dbde1fb3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:17.341183 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-87becb2b-8cdf-4cee-9206-e395dbde1fb3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:17.347585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87becb2b-8cdf-4cee-9206-e395dbde1fb3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:17.348030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87becb2b-8cdf-4cee-9206-e395dbde1fb3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:17.348794 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87becb2b-8cdf-4cee-9206-e395dbde1fb3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:17.349223 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87becb2b-8cdf-4cee-9206-e395dbde1fb3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:17.484625 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-87becb2b-8cdf-4cee-9206-e395dbde1fb3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:17.493051 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-87becb2b-8cdf-4cee-9206-e395dbde1fb3 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.156548 Apr 12 14:58:17.493619 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 280/567] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:17 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:18.510796 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1a767da3-3ad1-4745-a1b4-d82a42310f3b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:18.511380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1a767da3-3ad1-4745-a1b4-d82a42310f3b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:18.517899 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a767da3-3ad1-4745-a1b4-d82a42310f3b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:18.518348 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a767da3-3ad1-4745-a1b4-d82a42310f3b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:18.519112 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a767da3-3ad1-4745-a1b4-d82a42310f3b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:18.519548 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a767da3-3ad1-4745-a1b4-d82a42310f3b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:18.651756 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1a767da3-3ad1-4745-a1b4-d82a42310f3b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:18.659525 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1a767da3-3ad1-4745-a1b4-d82a42310f3b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.153125 Apr 12 14:58:18.660084 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 288/568] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:18 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:19.676843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-51f355f8-58e2-48fa-a930-09e3b1bcda59 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:19.677412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-51f355f8-58e2-48fa-a930-09e3b1bcda59 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:19.684391 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51f355f8-58e2-48fa-a930-09e3b1bcda59 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:19.684831 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51f355f8-58e2-48fa-a930-09e3b1bcda59 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:19.685648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51f355f8-58e2-48fa-a930-09e3b1bcda59 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:19.686033 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51f355f8-58e2-48fa-a930-09e3b1bcda59 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:19.821540 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-51f355f8-58e2-48fa-a930-09e3b1bcda59 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:19.829762 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-51f355f8-58e2-48fa-a930-09e3b1bcda59 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.156758 Apr 12 14:58:19.830339 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 281/569] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:19 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:20.806346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-aa15592e-e1cf-4856-b96c-016287b9f3dd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:20.806949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-aa15592e-e1cf-4856-b96c-016287b9f3dd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:20.813033 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa15592e-e1cf-4856-b96c-016287b9f3dd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:20.813469 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa15592e-e1cf-4856-b96c-016287b9f3dd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:20.814266 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa15592e-e1cf-4856-b96c-016287b9f3dd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:20.814689 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa15592e-e1cf-4856-b96c-016287b9f3dd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:20.843556 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-aa15592e-e1cf-4856-b96c-016287b9f3dd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments/53d61019-5f0c-4c43-8b84-d73cb849ec69" status: 200 len: 194 microversion: 2.20 time: 0.042579 Apr 12 14:58:20.844136 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 289/570] 10.222.0.64 () {60 vars in 1453 bytes} [Tue Apr 12 14:58:20 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments/53d61019-5f0c-4c43-8b84-d73cb849ec69 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:58:20.848174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fdb353ae-6368-4c9f-851b-681116b63453 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:20.848799 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fdb353ae-6368-4c9f-851b-681116b63453 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:20.856083 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fdb353ae-6368-4c9f-851b-681116b63453 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:20.856413 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fdb353ae-6368-4c9f-851b-681116b63453 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:20.857175 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fdb353ae-6368-4c9f-851b-681116b63453 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:20.857596 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fdb353ae-6368-4c9f-851b-681116b63453 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:20.907932 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-db83608c-1db6-4be2-bcc0-644debac9e4e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:20.908416 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-db83608c-1db6-4be2-bcc0-644debac9e4e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:20.915279 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db83608c-1db6-4be2-bcc0-644debac9e4e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:20.915728 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db83608c-1db6-4be2-bcc0-644debac9e4e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:20.916684 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db83608c-1db6-4be2-bcc0-644debac9e4e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:20.917111 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db83608c-1db6-4be2-bcc0-644debac9e4e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:21.000778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fdb353ae-6368-4c9f-851b-681116b63453 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:21.009183 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fdb353ae-6368-4c9f-851b-681116b63453 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.164702 Apr 12 14:58:21.009432 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-db83608c-1db6-4be2-bcc0-644debac9e4e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lazy-loading 'services' on Instance uuid 9d03f42e-2d51-459d-ade0-7e6a34283867 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:58:21.010027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 282/571] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:20 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:21.207069 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-db83608c-1db6-4be2-bcc0-644debac9e4e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments/53d61019-5f0c-4c43-8b84-d73cb849ec69" status: 202 len: 0 microversion: 2.20 time: 0.302869 Apr 12 14:58:21.207667 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 290/572] 10.222.0.64 () {60 vars in 1456 bytes} [Tue Apr 12 14:58:20 2022] DELETE /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments/53d61019-5f0c-4c43-8b84-d73cb849ec69 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 14:58:21.217182 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cfc0368a-5a55-4bf3-9a26-8907ce2eb181 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:21.218204 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cfc0368a-5a55-4bf3-9a26-8907ce2eb181 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:21.224761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfc0368a-5a55-4bf3-9a26-8907ce2eb181 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:21.225345 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfc0368a-5a55-4bf3-9a26-8907ce2eb181 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:21.226193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfc0368a-5a55-4bf3-9a26-8907ce2eb181 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:21.226628 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfc0368a-5a55-4bf3-9a26-8907ce2eb181 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:21.257019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cfc0368a-5a55-4bf3-9a26-8907ce2eb181 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043928 Apr 12 14:58:21.257500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 283/573] 10.222.0.64 () {60 vars in 1342 bytes} [Tue Apr 12 14:58:21 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:58:22.027085 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-32cf4cd4-c916-47e3-bb3f-c1fc4f5bbc80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:22.027813 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-32cf4cd4-c916-47e3-bb3f-c1fc4f5bbc80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:22.034139 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32cf4cd4-c916-47e3-bb3f-c1fc4f5bbc80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:22.034590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32cf4cd4-c916-47e3-bb3f-c1fc4f5bbc80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:22.035362 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32cf4cd4-c916-47e3-bb3f-c1fc4f5bbc80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:22.035798 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32cf4cd4-c916-47e3-bb3f-c1fc4f5bbc80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:22.168984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-32cf4cd4-c916-47e3-bb3f-c1fc4f5bbc80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:22.176831 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-32cf4cd4-c916-47e3-bb3f-c1fc4f5bbc80 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.154897 Apr 12 14:58:22.177323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 291/574] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:22 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:22.268803 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-12bde534-5e54-4863-b46c-d6dc1eee2620 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:22.269804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-12bde534-5e54-4863-b46c-d6dc1eee2620 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:22.276794 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-12bde534-5e54-4863-b46c-d6dc1eee2620 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:22.277240 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-12bde534-5e54-4863-b46c-d6dc1eee2620 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:22.278092 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-12bde534-5e54-4863-b46c-d6dc1eee2620 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:22.278526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-12bde534-5e54-4863-b46c-d6dc1eee2620 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:22.307742 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-12bde534-5e54-4863-b46c-d6dc1eee2620 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042904 Apr 12 14:58:22.308356 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 284/575] 10.222.0.64 () {60 vars in 1342 bytes} [Tue Apr 12 14:58:22 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:58:23.194389 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2f2afdeb-dc30-476b-bf92-b5646e38dd34 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:23.195009 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2f2afdeb-dc30-476b-bf92-b5646e38dd34 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:23.201943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f2afdeb-dc30-476b-bf92-b5646e38dd34 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:23.202813 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f2afdeb-dc30-476b-bf92-b5646e38dd34 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:23.203584 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f2afdeb-dc30-476b-bf92-b5646e38dd34 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:23.204012 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f2afdeb-dc30-476b-bf92-b5646e38dd34 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:23.319608 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1e589846-0dc7-42d8-bde9-02726a27bc25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:23.320649 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1e589846-0dc7-42d8-bde9-02726a27bc25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:23.327220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e589846-0dc7-42d8-bde9-02726a27bc25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:23.327665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e589846-0dc7-42d8-bde9-02726a27bc25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:23.328467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e589846-0dc7-42d8-bde9-02726a27bc25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:23.328900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1e589846-0dc7-42d8-bde9-02726a27bc25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:23.334027 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2f2afdeb-dc30-476b-bf92-b5646e38dd34 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:23.343526 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2f2afdeb-dc30-476b-bf92-b5646e38dd34 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.153420 Apr 12 14:58:23.344439 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 292/576] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:23 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:23.365582 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1e589846-0dc7-42d8-bde9-02726a27bc25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049897 Apr 12 14:58:23.366512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 285/577] 10.222.0.64 () {60 vars in 1342 bytes} [Tue Apr 12 14:58:23 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:23.425009 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1d566b19-6659-41a7-aab1-3969fbcd9f27 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:23.430101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1d566b19-6659-41a7-aab1-3969fbcd9f27 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:23.431874 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1d566b19-6659-41a7-aab1-3969fbcd9f27 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:23.432296 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1d566b19-6659-41a7-aab1-3969fbcd9f27 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:23.433075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1d566b19-6659-41a7-aab1-3969fbcd9f27 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:23.433508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1d566b19-6659-41a7-aab1-3969fbcd9f27 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:23.458535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1d566b19-6659-41a7-aab1-3969fbcd9f27 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 14:58:23.756720 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1d566b19-6659-41a7-aab1-3969fbcd9f27 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 204 len: 0 microversion: 2.20 time: 0.334733 Apr 12 14:58:23.757423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 293/578] 10.222.0.64 () {60 vars in 1279 bytes} [Tue Apr 12 14:58:23 2022] DELETE /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 14:58:23.765460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9ed9911f-6c77-40a1-8a07-f4ece29a5f3d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:23.766085 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9ed9911f-6c77-40a1-8a07-f4ece29a5f3d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:23.772742 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ed9911f-6c77-40a1-8a07-f4ece29a5f3d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:23.773205 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ed9911f-6c77-40a1-8a07-f4ece29a5f3d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:23.773991 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ed9911f-6c77-40a1-8a07-f4ece29a5f3d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:23.774423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ed9911f-6c77-40a1-8a07-f4ece29a5f3d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:23.901247 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ed9911f-6c77-40a1-8a07-f4ece29a5f3d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:23.909051 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ed9911f-6c77-40a1-8a07-f4ece29a5f3d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:23.910562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ed9911f-6c77-40a1-8a07-f4ece29a5f3d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:23.911686 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9ed9911f-6c77-40a1-8a07-f4ece29a5f3d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.150074 Apr 12 14:58:23.912716 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 286/579] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:23 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:24.363686 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ad3db090-b28a-494c-a958-627a2cb1ca74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:24.364323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ad3db090-b28a-494c-a958-627a2cb1ca74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:24.371356 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad3db090-b28a-494c-a958-627a2cb1ca74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:24.371800 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad3db090-b28a-494c-a958-627a2cb1ca74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:24.372561 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad3db090-b28a-494c-a958-627a2cb1ca74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:24.372993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad3db090-b28a-494c-a958-627a2cb1ca74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:24.504658 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ad3db090-b28a-494c-a958-627a2cb1ca74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:24.513387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ad3db090-b28a-494c-a958-627a2cb1ca74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.155256 Apr 12 14:58:24.514180 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 294/580] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:24 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:24.930354 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4dd58cfe-6bc2-4d6f-a9ae-e4ce637ded8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:24.930952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4dd58cfe-6bc2-4d6f-a9ae-e4ce637ded8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:24.937174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4dd58cfe-6bc2-4d6f-a9ae-e4ce637ded8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:24.937620 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4dd58cfe-6bc2-4d6f-a9ae-e4ce637ded8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:24.938403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4dd58cfe-6bc2-4d6f-a9ae-e4ce637ded8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:24.938832 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4dd58cfe-6bc2-4d6f-a9ae-e4ce637ded8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:25.062493 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4dd58cfe-6bc2-4d6f-a9ae-e4ce637ded8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:25.070999 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4dd58cfe-6bc2-4d6f-a9ae-e4ce637ded8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:25.072508 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4dd58cfe-6bc2-4d6f-a9ae-e4ce637ded8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:25.073690 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4dd58cfe-6bc2-4d6f-a9ae-e4ce637ded8c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.147320 Apr 12 14:58:25.074518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 287/581] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:24 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:25.532891 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0a80f51b-90db-4d3f-b3d0-b549cab6bedc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:25.533550 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0a80f51b-90db-4d3f-b3d0-b549cab6bedc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:25.540579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a80f51b-90db-4d3f-b3d0-b549cab6bedc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:25.541059 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a80f51b-90db-4d3f-b3d0-b549cab6bedc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:25.541854 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a80f51b-90db-4d3f-b3d0-b549cab6bedc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:25.542281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a80f51b-90db-4d3f-b3d0-b549cab6bedc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:25.677341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0a80f51b-90db-4d3f-b3d0-b549cab6bedc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:25.686017 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0a80f51b-90db-4d3f-b3d0-b549cab6bedc tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.157430 Apr 12 14:58:25.686597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 295/582] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:25 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:26.092480 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-aebbeca9-75af-4bf9-b5f0-b010fec316f7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:26.093100 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-aebbeca9-75af-4bf9-b5f0-b010fec316f7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:26.099659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aebbeca9-75af-4bf9-b5f0-b010fec316f7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:26.100174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aebbeca9-75af-4bf9-b5f0-b010fec316f7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:26.101098 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aebbeca9-75af-4bf9-b5f0-b010fec316f7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:26.101463 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aebbeca9-75af-4bf9-b5f0-b010fec316f7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:26.229154 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aebbeca9-75af-4bf9-b5f0-b010fec316f7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:26.236929 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aebbeca9-75af-4bf9-b5f0-b010fec316f7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:26.238471 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aebbeca9-75af-4bf9-b5f0-b010fec316f7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:26.239608 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-aebbeca9-75af-4bf9-b5f0-b010fec316f7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1723 microversion: 2.20 time: 0.151181 Apr 12 14:58:26.240160 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 288/583] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:26 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:26.603896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-082bb185-1c1d-4583-8af5-a3fa6ac7ebbd req-73868c6d-f663-4639-9bf3-d2faebeb8e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d03f42e-2d51-459d-ade0-7e6a34283867", "name": "network-vif-deleted", "tag": "90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:26.612290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-082bb185-1c1d-4583-8af5-a3fa6ac7ebbd req-73868c6d-f663-4639-9bf3-d2faebeb8e7d service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:26.612857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-082bb185-1c1d-4583-8af5-a3fa6ac7ebbd req-73868c6d-f663-4639-9bf3-d2faebeb8e7d service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:26.624486 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-082bb185-1c1d-4583-8af5-a3fa6ac7ebbd req-73868c6d-f663-4639-9bf3-d2faebeb8e7d service nova] Creating event network-vif-deleted:90cc2ae2-1bf0-46e2-aaa3-df8b5b8c5f77 for instance 9d03f42e-2d51-459d-ade0-7e6a34283867 on hv-cinder-83752 Apr 12 14:58:26.629593 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-082bb185-1c1d-4583-8af5-a3fa6ac7ebbd req-73868c6d-f663-4639-9bf3-d2faebeb8e7d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029917 Apr 12 14:58:26.630294 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 296/584] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:26.712403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d605c305-e4f3-4e76-b939-170d7289c8fa tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:26.713898 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d605c305-e4f3-4e76-b939-170d7289c8fa tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:26.720511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d605c305-e4f3-4e76-b939-170d7289c8fa tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:26.720949 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d605c305-e4f3-4e76-b939-170d7289c8fa tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:26.721750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d605c305-e4f3-4e76-b939-170d7289c8fa tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:26.722181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d605c305-e4f3-4e76-b939-170d7289c8fa tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:26.883263 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d605c305-e4f3-4e76-b939-170d7289c8fa tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:26.894461 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d605c305-e4f3-4e76-b939-170d7289c8fa tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.191242 Apr 12 14:58:26.895248 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 289/585] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:26 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:27.260575 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:27.261476 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:27.267519 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:27.267953 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:27.268738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:27.269162 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:27.307449 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:27.308189 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:27.308931 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lazy-loading 'fault' on Instance uuid 9d03f42e-2d51-459d-ade0-7e6a34283867 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:58:27.354359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:27.363049 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:27.364367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:27.366353 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b1c3dae7-b9b4-43c0-97fd-351ae543ff41 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 200 len: 1372 microversion: 2.20 time: 0.110433 Apr 12 14:58:27.367036 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 297/586] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:27 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:27.757739 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1a32d934-532b-4a4e-b303-bb75766bb750 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:27.758677 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1a32d934-532b-4a4e-b303-bb75766bb750 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:27.764922 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1a32d934-532b-4a4e-b303-bb75766bb750 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:27.765368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1a32d934-532b-4a4e-b303-bb75766bb750 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:27.766161 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1a32d934-532b-4a4e-b303-bb75766bb750 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:27.766596 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1a32d934-532b-4a4e-b303-bb75766bb750 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:27.795192 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1a32d934-532b-4a4e-b303-bb75766bb750 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041431 Apr 12 14:58:27.795755 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 290/587] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:58:27 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 14:58:27.857217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-cb819a8e-37f5-42da-ba1b-f42cdd1bca18 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:27.857728 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cb819a8e-37f5-42da-ba1b-f42cdd1bca18 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:27.863987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cb819a8e-37f5-42da-ba1b-f42cdd1bca18 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:27.864430 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cb819a8e-37f5-42da-ba1b-f42cdd1bca18 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:27.865186 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cb819a8e-37f5-42da-ba1b-f42cdd1bca18 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:27.866301 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cb819a8e-37f5-42da-ba1b-f42cdd1bca18 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:27.890331 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cb819a8e-37f5-42da-ba1b-f42cdd1bca18 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 14:58:27.914429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5ff6f3bb-98b3-4ed8-a3dd-5c43d9559ef0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:27.915321 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5ff6f3bb-98b3-4ed8-a3dd-5c43d9559ef0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:27.923394 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5ff6f3bb-98b3-4ed8-a3dd-5c43d9559ef0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:27.923915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5ff6f3bb-98b3-4ed8-a3dd-5c43d9559ef0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:27.924904 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5ff6f3bb-98b3-4ed8-a3dd-5c43d9559ef0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:27.925340 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5ff6f3bb-98b3-4ed8-a3dd-5c43d9559ef0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:28.054272 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5ff6f3bb-98b3-4ed8-a3dd-5c43d9559ef0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:28.062977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5ff6f3bb-98b3-4ed8-a3dd-5c43d9559ef0 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.154432 Apr 12 14:58:28.063646 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 291/588] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:27 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:28.239473 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-cb819a8e-37f5-42da-ba1b-f42cdd1bca18 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "DELETE /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 204 len: 0 microversion: 2.1 time: 0.385798 Apr 12 14:58:28.240210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 298/589] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 14:58:27 2022] DELETE /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 14:58:28.249205 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0efc7744-3d41-4860-b78d-ca2c9ed3d50f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:28.249840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0efc7744-3d41-4860-b78d-ca2c9ed3d50f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:28.255732 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0efc7744-3d41-4860-b78d-ca2c9ed3d50f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:28.256178 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0efc7744-3d41-4860-b78d-ca2c9ed3d50f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:28.256947 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0efc7744-3d41-4860-b78d-ca2c9ed3d50f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:28.257370 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0efc7744-3d41-4860-b78d-ca2c9ed3d50f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:28.385491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a755b58e-4b62-46a3-b65d-17a5abb92e03 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:28.386359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a755b58e-4b62-46a3-b65d-17a5abb92e03 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:28.387206 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0efc7744-3d41-4860-b78d-ca2c9ed3d50f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:28.392231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a755b58e-4b62-46a3-b65d-17a5abb92e03 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:28.392673 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a755b58e-4b62-46a3-b65d-17a5abb92e03 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:28.393434 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a755b58e-4b62-46a3-b65d-17a5abb92e03 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:28.393883 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a755b58e-4b62-46a3-b65d-17a5abb92e03 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:28.394369 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0efc7744-3d41-4860-b78d-ca2c9ed3d50f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1673 microversion: 2.1 time: 0.149107 Apr 12 14:58:28.394960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 292/590] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:28 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:28.407112 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-a755b58e-4b62-46a3-b65d-17a5abb92e03 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] HTTP exception thrown: Instance 9d03f42e-2d51-459d-ade0-7e6a34283867 could not be found. Apr 12 14:58:28.407685 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a755b58e-4b62-46a3-b65d-17a5abb92e03 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Returning 404 to user: Instance 9d03f42e-2d51-459d-ade0-7e6a34283867 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:58:28.408490 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a755b58e-4b62-46a3-b65d-17a5abb92e03 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 404 len: 111 microversion: 2.20 time: 0.027698 Apr 12 14:58:28.409008 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 299/591] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:28 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 12 14:58:28.417791 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e119b623-e12d-4514-9b5e-d024d949c0d4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '.version_select at 0x7fbd608f09d0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:28.492665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e119b623-e12d-4514-9b5e-d024d949c0d4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523394437" status: 204 len: 0 microversion: 2.20 time: 0.078430 Apr 12 14:58:28.493575 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 293/592] 10.222.0.64 () {60 vars in 1261 bytes} [Tue Apr 12 14:58:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523394437 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 12 14:58:29.081125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8521a6fd-60cc-4d35-885d-3e27be63b48c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:29.081759 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8521a6fd-60cc-4d35-885d-3e27be63b48c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:29.088892 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8521a6fd-60cc-4d35-885d-3e27be63b48c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:29.089335 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8521a6fd-60cc-4d35-885d-3e27be63b48c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:29.090194 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8521a6fd-60cc-4d35-885d-3e27be63b48c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:29.090623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8521a6fd-60cc-4d35-885d-3e27be63b48c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:29.273200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5f2c2b2a-cc6d-45e9-8df1-812b3fa34661 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Action: 'create', calling method: .version_select at 0x7fbd608cf790>, body: {"keypair": {"name": "tempest-keypair-1082056460"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:29.288247 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-5f2c2b2a-cc6d-45e9-8df1-812b3fa34661 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for project 7c2a576e2be74418bdef57686bad30a2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:58:29.292319 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-5f2c2b2a-cc6d-45e9-8df1-812b3fa34661 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for user 1719e64e58b14e63b4f2738410cf114f and project 7c2a576e2be74418bdef57686bad30a2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:58:29.295096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8521a6fd-60cc-4d35-885d-3e27be63b48c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:29.305214 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8521a6fd-60cc-4d35-885d-3e27be63b48c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.228102 Apr 12 14:58:29.306167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 300/593] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:29 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:29.411834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-63da0230-fdb9-47d5-9a70-4afee3ea5ad2 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:29.412385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-63da0230-fdb9-47d5-9a70-4afee3ea5ad2 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:29.418385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-63da0230-fdb9-47d5-9a70-4afee3ea5ad2 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:29.418830 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-63da0230-fdb9-47d5-9a70-4afee3ea5ad2 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:29.419594 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-63da0230-fdb9-47d5-9a70-4afee3ea5ad2 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:29.420026 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-63da0230-fdb9-47d5-9a70-4afee3ea5ad2 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:29.554409 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-63da0230-fdb9-47d5-9a70-4afee3ea5ad2 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:29.561601 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-63da0230-fdb9-47d5-9a70-4afee3ea5ad2 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1673 microversion: 2.1 time: 0.153744 Apr 12 14:58:29.562194 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 301/594] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:29 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:29.616104 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-5f2c2b2a-cc6d-45e9-8df1-812b3fa34661 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for project 7c2a576e2be74418bdef57686bad30a2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:58:29.619881 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-5f2c2b2a-cc6d-45e9-8df1-812b3fa34661 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for user 1719e64e58b14e63b4f2738410cf114f and project 7c2a576e2be74418bdef57686bad30a2. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:58:29.633059 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5f2c2b2a-cc6d-45e9-8df1-812b3fa34661 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.364342 Apr 12 14:58:29.633750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 294/595] 10.222.0.64 () {62 vars in 1198 bytes} [Tue Apr 12 14:58:29 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 366 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 12 14:58:30.322509 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-89ae4316-36bf-4d8f-9941-6182980b3a20 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:30.323153 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-89ae4316-36bf-4d8f-9941-6182980b3a20 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:30.329922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89ae4316-36bf-4d8f-9941-6182980b3a20 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:30.330367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89ae4316-36bf-4d8f-9941-6182980b3a20 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:30.331232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89ae4316-36bf-4d8f-9941-6182980b3a20 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:30.331665 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-89ae4316-36bf-4d8f-9941-6182980b3a20 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:30.485817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-89ae4316-36bf-4d8f-9941-6182980b3a20 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:30.498746 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-89ae4316-36bf-4d8f-9941-6182980b3a20 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1734 microversion: 2.1 time: 0.180273 Apr 12 14:58:30.499650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 302/596] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:30 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:30.580659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dc3240dd-45a7-4ab4-9140-e2946e14c89f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:30.581447 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dc3240dd-45a7-4ab4-9140-e2946e14c89f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:30.588146 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3240dd-45a7-4ab4-9140-e2946e14c89f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:30.588593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3240dd-45a7-4ab4-9140-e2946e14c89f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:30.589367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3240dd-45a7-4ab4-9140-e2946e14c89f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:30.589846 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc3240dd-45a7-4ab4-9140-e2946e14c89f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:30.722074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dc3240dd-45a7-4ab4-9140-e2946e14c89f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:30.729933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dc3240dd-45a7-4ab4-9140-e2946e14c89f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1673 microversion: 2.1 time: 0.153692 Apr 12 14:58:30.730510 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 295/597] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:30 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:31.517753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-72d46428-cf62-4945-96da-ced16dc7597f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:31.518403 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-72d46428-cf62-4945-96da-ced16dc7597f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:31.528619 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-72d46428-cf62-4945-96da-ced16dc7597f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:31.528940 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-72d46428-cf62-4945-96da-ced16dc7597f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:31.529707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-72d46428-cf62-4945-96da-ced16dc7597f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:31.530151 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-72d46428-cf62-4945-96da-ced16dc7597f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:31.670635 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-72d46428-cf62-4945-96da-ced16dc7597f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:31.678846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-72d46428-cf62-4945-96da-ced16dc7597f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1714 microversion: 2.1 time: 0.164767 Apr 12 14:58:31.679821 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 303/598] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:31 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1714 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:31.749873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c9281e97-e96c-4a79-aeac-1102fecd3e02 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:31.750578 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c9281e97-e96c-4a79-aeac-1102fecd3e02 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:31.757011 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9281e97-e96c-4a79-aeac-1102fecd3e02 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:31.757456 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9281e97-e96c-4a79-aeac-1102fecd3e02 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:31.758425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9281e97-e96c-4a79-aeac-1102fecd3e02 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:31.759416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9281e97-e96c-4a79-aeac-1102fecd3e02 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:31.786705 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-26ae27a7-fedf-40e0-a4cd-f055232f7ffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:31.787193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-26ae27a7-fedf-40e0-a4cd-f055232f7ffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:31.794098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-26ae27a7-fedf-40e0-a4cd-f055232f7ffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:31.795398 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-26ae27a7-fedf-40e0-a4cd-f055232f7ffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:31.796186 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-26ae27a7-fedf-40e0-a4cd-f055232f7ffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:31.796845 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-26ae27a7-fedf-40e0-a4cd-f055232f7ffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:31.892690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-26ae27a7-fedf-40e0-a4cd-f055232f7ffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] HTTP exception thrown: Cannot 'detach_volume' instance dfd692aa-e03c-4686-8512-e5b6d426893f while it is in vm_state rescued Apr 12 14:58:31.893574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-26ae27a7-fedf-40e0-a4cd-f055232f7ffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Returning 409 to user: Cannot 'detach_volume' instance dfd692aa-e03c-4686-8512-e5b6d426893f while it is in vm_state rescued {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:58:31.894597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-26ae27a7-fedf-40e0-a4cd-f055232f7ffb tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "DELETE /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments/41d810ab-a6f6-44c7-b504-cbdadfbf3aa9" status: 409 len: 152 microversion: 2.1 time: 0.111869 Apr 12 14:58:31.895217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 304/599] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Apr 12 14:58:31 2022] DELETE /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments/41d810ab-a6f6-44c7-b504-cbdadfbf3aa9 => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 14:58:31.906175 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0bde6f17-4ee9-43ea-a7bb-3a7347d521f6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:31.907030 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0bde6f17-4ee9-43ea-a7bb-3a7347d521f6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:31.910710 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c9281e97-e96c-4a79-aeac-1102fecd3e02 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:31.914464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bde6f17-4ee9-43ea-a7bb-3a7347d521f6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:31.914978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bde6f17-4ee9-43ea-a7bb-3a7347d521f6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:31.916188 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bde6f17-4ee9-43ea-a7bb-3a7347d521f6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:31.916778 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bde6f17-4ee9-43ea-a7bb-3a7347d521f6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:31.920380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c9281e97-e96c-4a79-aeac-1102fecd3e02 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1673 microversion: 2.1 time: 0.174434 Apr 12 14:58:31.921268 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 296/600] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:31 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:32.176647 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0bde6f17-4ee9-43ea-a7bb-3a7347d521f6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "POST /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/action" status: 202 len: 0 microversion: 2.1 time: 0.274559 Apr 12 14:58:32.177538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 305/601] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 14:58:31 2022] POST /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:58:32.188286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-495c9f44-24ae-45e9-addf-728548863aad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:32.189355 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-495c9f44-24ae-45e9-addf-728548863aad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:32.198372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-495c9f44-24ae-45e9-addf-728548863aad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:32.199352 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-495c9f44-24ae-45e9-addf-728548863aad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:32.200310 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-495c9f44-24ae-45e9-addf-728548863aad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:32.200767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-495c9f44-24ae-45e9-addf-728548863aad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:32.335868 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-495c9f44-24ae-45e9-addf-728548863aad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:32.343892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-495c9f44-24ae-45e9-addf-728548863aad tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1722 microversion: 2.1 time: 0.159770 Apr 12 14:58:32.344534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 297/602] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:32 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:32.474749 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1902800907", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5444df66-cec9-4e6f-babf-6afcab69a266"}], "security_groups": [{"name": "tempest-securitygroup--1320408168"}], "key_name": "tempest-keypair-1082056460", "user_data": "}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:32.595880 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] validate_networks() for [('5444df66-cec9-4e6f-babf-6afcab69a266', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:58:32.815258 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-92d8868c-20e8-4684-9487-ddecde5a58e5 req-43a0e199-e3de-410d-a951-cc31709a1166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3e6773-eb1f-4098-b443-1b2d62d1abe8", "name": "network-vif-deleted", "tag": "7448f465-5339-4bd1-91a9-94095a601931"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:32.828149 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-92d8868c-20e8-4684-9487-ddecde5a58e5 req-43a0e199-e3de-410d-a951-cc31709a1166 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:32.828817 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-92d8868c-20e8-4684-9487-ddecde5a58e5 req-43a0e199-e3de-410d-a951-cc31709a1166 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:32.849506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-92d8868c-20e8-4684-9487-ddecde5a58e5 req-43a0e199-e3de-410d-a951-cc31709a1166 service nova] Creating event network-vif-deleted:7448f465-5339-4bd1-91a9-94095a601931 for instance cc3e6773-eb1f-4098-b443-1b2d62d1abe8 on hv-cinder-83752 Apr 12 14:58:32.856670 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-92d8868c-20e8-4684-9487-ddecde5a58e5 req-43a0e199-e3de-410d-a951-cc31709a1166 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046656 Apr 12 14:58:32.857934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 298/603] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:58:32.938840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3ad1edb9-e643-4245-b732-76743e0dcc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:32.940287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3ad1edb9-e643-4245-b732-76743e0dcc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:32.948489 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ad1edb9-e643-4245-b732-76743e0dcc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:32.949728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ad1edb9-e643-4245-b732-76743e0dcc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:32.950789 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ad1edb9-e643-4245-b732-76743e0dcc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:32.951383 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ad1edb9-e643-4245-b732-76743e0dcc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:33.039016 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3ad1edb9-e643-4245-b732-76743e0dcc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:33.047979 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3ad1edb9-e643-4245-b732-76743e0dcc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1607 microversion: 2.1 time: 0.113373 Apr 12 14:58:33.048889 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 299/604] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:32 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1607 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:33.358132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:58:33.358551 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:58:33.359191 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:58:33.359872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:58:33.360285 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:58:33.361767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7f12b953-a8c9-4a7d-b181-b6804797e33c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:33.362384 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7f12b953-a8c9-4a7d-b181-b6804797e33c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:33.368349 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f12b953-a8c9-4a7d-b181-b6804797e33c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:33.368796 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f12b953-a8c9-4a7d-b181-b6804797e33c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:33.369393 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:33.369568 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f12b953-a8c9-4a7d-b181-b6804797e33c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:33.369895 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:33.370015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7f12b953-a8c9-4a7d-b181-b6804797e33c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:33.370777 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:33.371215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:33.389624 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for project 7c2a576e2be74418bdef57686bad30a2. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:58:33.394417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Getting quotas for user 1719e64e58b14e63b4f2738410cf114f and project 7c2a576e2be74418bdef57686bad30a2. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:58:33.407532 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:58:33.410189 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:58:33.503848 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7f12b953-a8c9-4a7d-b181-b6804797e33c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:33.515125 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7f12b953-a8c9-4a7d-b181-b6804797e33c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1722 microversion: 2.1 time: 0.157155 Apr 12 14:58:33.516404 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 300/605] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:33 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:33.549820 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6a369161-8fc3-4aba-8731-b5fbcf8c0bab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.079444 Apr 12 14:58:33.550612 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 306/606] 10.222.0.64 () {62 vars in 1187 bytes} [Tue Apr 12 14:58:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 12 14:58:33.566920 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9fb1db8c-f85a-4be4-9296-d47b6efc6e6f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:33.567529 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9fb1db8c-f85a-4be4-9296-d47b6efc6e6f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:33.624409 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fb1db8c-f85a-4be4-9296-d47b6efc6e6f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:33.639457 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fb1db8c-f85a-4be4-9296-d47b6efc6e6f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:33.639457 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fb1db8c-f85a-4be4-9296-d47b6efc6e6f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:33.639457 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9fb1db8c-f85a-4be4-9296-d47b6efc6e6f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1282 microversion: 2.20 time: 0.078167 Apr 12 14:58:33.641708 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 301/607] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:33 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:34.066163 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:34.066830 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:34.074820 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:34.075279 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:34.076059 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:34.076512 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:34.108222 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:34.108665 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:34.109107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lazy-loading 'fault' on Instance uuid cc3e6773-eb1f-4098-b443-1b2d62d1abe8 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:58:34.155283 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:34.164043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7c27e86b-9f71-408e-a2cd-998cb6ebdc5e tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 200 len: 1327 microversion: 2.1 time: 0.101667 Apr 12 14:58:34.164717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 307/608] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:34 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:34.533315 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-75af85f4-436e-4bb4-8ceb-e6ecf3c8ed74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:34.533964 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-75af85f4-436e-4bb4-8ceb-e6ecf3c8ed74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:34.542123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75af85f4-436e-4bb4-8ceb-e6ecf3c8ed74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:34.542560 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75af85f4-436e-4bb4-8ceb-e6ecf3c8ed74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:34.543322 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75af85f4-436e-4bb4-8ceb-e6ecf3c8ed74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:34.543748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75af85f4-436e-4bb4-8ceb-e6ecf3c8ed74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:34.658134 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-57933803-66ef-4f91-a27c-802b2bf8ceaa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:34.658841 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-57933803-66ef-4f91-a27c-802b2bf8ceaa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:34.665623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57933803-66ef-4f91-a27c-802b2bf8ceaa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:34.666098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57933803-66ef-4f91-a27c-802b2bf8ceaa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:34.666875 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57933803-66ef-4f91-a27c-802b2bf8ceaa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:34.667301 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-57933803-66ef-4f91-a27c-802b2bf8ceaa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:34.677100 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-75af85f4-436e-4bb4-8ceb-e6ecf3c8ed74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:34.690377 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-75af85f4-436e-4bb4-8ceb-e6ecf3c8ed74 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1722 microversion: 2.1 time: 0.160967 Apr 12 14:58:34.691086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 302/609] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:34 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:34.730262 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-57933803-66ef-4f91-a27c-802b2bf8ceaa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:34.738138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-57933803-66ef-4f91-a27c-802b2bf8ceaa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:34.741259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-57933803-66ef-4f91-a27c-802b2bf8ceaa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:34.741259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-57933803-66ef-4f91-a27c-802b2bf8ceaa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1286 microversion: 2.20 time: 0.086473 Apr 12 14:58:34.741905 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 308/610] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:34 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:58:35.182383 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-79895cc4-0793-4232-bcf0-0532070d6a4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:35.183135 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-79895cc4-0793-4232-bcf0-0532070d6a4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:35.189229 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79895cc4-0793-4232-bcf0-0532070d6a4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:35.189707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79895cc4-0793-4232-bcf0-0532070d6a4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:35.190485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79895cc4-0793-4232-bcf0-0532070d6a4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:35.190919 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-79895cc4-0793-4232-bcf0-0532070d6a4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:35.205059 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-79895cc4-0793-4232-bcf0-0532070d6a4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] HTTP exception thrown: Instance cc3e6773-eb1f-4098-b443-1b2d62d1abe8 could not be found. Apr 12 14:58:35.205677 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-79895cc4-0793-4232-bcf0-0532070d6a4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Returning 404 to user: Instance cc3e6773-eb1f-4098-b443-1b2d62d1abe8 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:58:35.206513 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-79895cc4-0793-4232-bcf0-0532070d6a4d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 404 len: 111 microversion: 2.1 time: 0.028174 Apr 12 14:58:35.207073 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 303/611] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:35 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:58:35.216259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-91676e9e-2283-4371-9280-8ea9f2aeebef tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '.version_select at 0x7fbd60833670>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:35.277535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-91676e9e-2283-4371-9280-8ea9f2aeebef tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-776052136" status: 202 len: 0 microversion: 2.1 time: 0.065022 Apr 12 14:58:35.278148 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 309/612] 10.222.0.64 () {58 vars in 1217 bytes} [Tue Apr 12 14:58:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-776052136 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 14:58:35.709106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-eabcea19-1cfe-4f01-a9a3-48eaf1f2c753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:35.710930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-eabcea19-1cfe-4f01-a9a3-48eaf1f2c753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:35.716893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eabcea19-1cfe-4f01-a9a3-48eaf1f2c753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:35.717340 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eabcea19-1cfe-4f01-a9a3-48eaf1f2c753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:35.718141 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eabcea19-1cfe-4f01-a9a3-48eaf1f2c753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:35.718577 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eabcea19-1cfe-4f01-a9a3-48eaf1f2c753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:35.760096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a32dcf50-c3b8-4ffe-97dc-fe5dfa161d9c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:35.760839 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a32dcf50-c3b8-4ffe-97dc-fe5dfa161d9c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:35.770627 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a32dcf50-c3b8-4ffe-97dc-fe5dfa161d9c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:35.770627 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a32dcf50-c3b8-4ffe-97dc-fe5dfa161d9c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:35.770627 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a32dcf50-c3b8-4ffe-97dc-fe5dfa161d9c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:35.770627 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a32dcf50-c3b8-4ffe-97dc-fe5dfa161d9c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:35.882936 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a32dcf50-c3b8-4ffe-97dc-fe5dfa161d9c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:35.891552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a32dcf50-c3b8-4ffe-97dc-fe5dfa161d9c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:35.893097 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a32dcf50-c3b8-4ffe-97dc-fe5dfa161d9c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:35.894322 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a32dcf50-c3b8-4ffe-97dc-fe5dfa161d9c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1334 microversion: 2.20 time: 0.139637 Apr 12 14:58:35.895002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 310/613] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:35 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1334 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:58:35.941018 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-eabcea19-1cfe-4f01-a9a3-48eaf1f2c753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:35.950667 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-eabcea19-1cfe-4f01-a9a3-48eaf1f2c753 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1728 microversion: 2.1 time: 0.245376 Apr 12 14:58:35.951219 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 304/614] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:35 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:36.101950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0610de5e-defb-4188-8044-8a511124a115 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:36.101950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0610de5e-defb-4188-8044-8a511124a115 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:36.101950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0610de5e-defb-4188-8044-8a511124a115 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:36.101950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0610de5e-defb-4188-8044-8a511124a115 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:36.102491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0610de5e-defb-4188-8044-8a511124a115 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:36.102491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0610de5e-defb-4188-8044-8a511124a115 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:36.171389 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0610de5e-defb-4188-8044-8a511124a115 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094920 Apr 12 14:58:36.172013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 311/615] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Apr 12 14:58:36 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:36.308968 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a85cbb08-fd7e-4e10-b08d-70dd955044fc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'create', calling method: .version_select at 0x7fbd60a65430>, body: {"keypair": {"name": "tempest-keypair-1876850993"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:36.323372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-a85cbb08-fd7e-4e10-b08d-70dd955044fc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:58:36.327511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-a85cbb08-fd7e-4e10-b08d-70dd955044fc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for user d317bfa69daa49f286fd8c216e9f415a and project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:58:36.744978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-a85cbb08-fd7e-4e10-b08d-70dd955044fc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:58:36.749368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-a85cbb08-fd7e-4e10-b08d-70dd955044fc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for user d317bfa69daa49f286fd8c216e9f415a and project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'key_pairs'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:58:36.764756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a85cbb08-fd7e-4e10-b08d-70dd955044fc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.459557 Apr 12 14:58:36.765480 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 305/616] 10.222.0.64 () {60 vars in 1157 bytes} [Tue Apr 12 14:58:36 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:36.920795 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8c25b000-efe9-4119-b5ab-e9a2b2f333fa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:36.921557 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8c25b000-efe9-4119-b5ab-e9a2b2f333fa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:36.927535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c25b000-efe9-4119-b5ab-e9a2b2f333fa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:36.928156 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c25b000-efe9-4119-b5ab-e9a2b2f333fa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:36.929734 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c25b000-efe9-4119-b5ab-e9a2b2f333fa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:36.930455 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8c25b000-efe9-4119-b5ab-e9a2b2f333fa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:37.018174 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8c25b000-efe9-4119-b5ab-e9a2b2f333fa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:37.027821 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8c25b000-efe9-4119-b5ab-e9a2b2f333fa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:37.029876 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8c25b000-efe9-4119-b5ab-e9a2b2f333fa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:37.031417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8c25b000-efe9-4119-b5ab-e9a2b2f333fa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1340 microversion: 2.20 time: 0.115156 Apr 12 14:58:37.032686 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 312/617] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:36 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:37.394593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-63d7982d-a5f1-43a9-9d10-a1825f8f553c req-a37a253c-0a46-43b8-abc3-a2293779a8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd692aa-e03c-4686-8512-e5b6d426893f", "tag": "d0d6b7ba-aadc-4c5d-96b6-feb347509ccf"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:37.414679 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-63d7982d-a5f1-43a9-9d10-a1825f8f553c req-a37a253c-0a46-43b8-abc3-a2293779a8e7 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:37.415112 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-63d7982d-a5f1-43a9-9d10-a1825f8f553c req-a37a253c-0a46-43b8-abc3-a2293779a8e7 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:37.432580 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-63d7982d-a5f1-43a9-9d10-a1825f8f553c req-a37a253c-0a46-43b8-abc3-a2293779a8e7 service nova] Creating event network-changed:d0d6b7ba-aadc-4c5d-96b6-feb347509ccf for instance dfd692aa-e03c-4686-8512-e5b6d426893f on hv-cinder-83752 Apr 12 14:58:37.438812 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-63d7982d-a5f1-43a9-9d10-a1825f8f553c req-a37a253c-0a46-43b8-abc3-a2293779a8e7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047559 Apr 12 14:58:37.440050 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 306/618] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:38.050886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fe84894b-8570-40c1-bdbe-76e5268767ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:38.051429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fe84894b-8570-40c1-bdbe-76e5268767ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:38.058808 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fe84894b-8570-40c1-bdbe-76e5268767ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:38.071758 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fe84894b-8570-40c1-bdbe-76e5268767ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:38.073100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fe84894b-8570-40c1-bdbe-76e5268767ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:38.074046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fe84894b-8570-40c1-bdbe-76e5268767ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:38.262396 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fe84894b-8570-40c1-bdbe-76e5268767ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:38.272359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fe84894b-8570-40c1-bdbe-76e5268767ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:38.273896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fe84894b-8570-40c1-bdbe-76e5268767ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:38.275109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fe84894b-8570-40c1-bdbe-76e5268767ab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1408 microversion: 2.20 time: 0.228284 Apr 12 14:58:38.277680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 313/619] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:38 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:39.298084 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9199da3c-9088-40cd-bc4e-91e6172b3102 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:39.299460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9199da3c-9088-40cd-bc4e-91e6172b3102 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:39.306413 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9199da3c-9088-40cd-bc4e-91e6172b3102 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:39.313305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9199da3c-9088-40cd-bc4e-91e6172b3102 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:39.313305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9199da3c-9088-40cd-bc4e-91e6172b3102 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:39.313305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9199da3c-9088-40cd-bc4e-91e6172b3102 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:39.341472 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-802256a9-531c-4e1e-9331-58684573f980 req-e99ebb5e-1e04-4fd6-9542-030526c99c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946d8ea7-5cb9-4e2f-99b4-27f342c44b63", "tag": "5c58da46-e5bb-4b4a-8051-745b00e75ae2"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:39.365421 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-802256a9-531c-4e1e-9331-58684573f980 req-e99ebb5e-1e04-4fd6-9542-030526c99c4f service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:39.366986 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-802256a9-531c-4e1e-9331-58684573f980 req-e99ebb5e-1e04-4fd6-9542-030526c99c4f service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:39.380132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-802256a9-531c-4e1e-9331-58684573f980 req-e99ebb5e-1e04-4fd6-9542-030526c99c4f service nova] Creating event network-changed:5c58da46-e5bb-4b4a-8051-745b00e75ae2 for instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 on hv-cinder-83752 Apr 12 14:58:39.388344 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-802256a9-531c-4e1e-9331-58684573f980 req-e99ebb5e-1e04-4fd6-9542-030526c99c4f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063769 Apr 12 14:58:39.389783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 314/620] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:39.459999 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-cd6553ae-8d21-4805-8f2f-ed41682ae211 req-d9846b02-4dc2-45d4-9969-a57f86502d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd692aa-e03c-4686-8512-e5b6d426893f", "tag": "d0d6b7ba-aadc-4c5d-96b6-feb347509ccf"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:39.469567 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-cd6553ae-8d21-4805-8f2f-ed41682ae211 req-d9846b02-4dc2-45d4-9969-a57f86502d9e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:39.470038 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-cd6553ae-8d21-4805-8f2f-ed41682ae211 req-d9846b02-4dc2-45d4-9969-a57f86502d9e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:39.474201 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9199da3c-9088-40cd-bc4e-91e6172b3102 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:39.483796 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9199da3c-9088-40cd-bc4e-91e6172b3102 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:39.485367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9199da3c-9088-40cd-bc4e-91e6172b3102 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:39.486512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9199da3c-9088-40cd-bc4e-91e6172b3102 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1408 microversion: 2.20 time: 0.193924 Apr 12 14:58:39.487928 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 307/621] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:39 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:39.499299 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-cd6553ae-8d21-4805-8f2f-ed41682ae211 req-d9846b02-4dc2-45d4-9969-a57f86502d9e service nova] Creating event network-changed:d0d6b7ba-aadc-4c5d-96b6-feb347509ccf for instance dfd692aa-e03c-4686-8512-e5b6d426893f on hv-cinder-83752 Apr 12 14:58:39.505682 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-cd6553ae-8d21-4805-8f2f-ed41682ae211 req-d9846b02-4dc2-45d4-9969-a57f86502d9e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050847 Apr 12 14:58:39.507707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 315/622] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:40.504937 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f7e5ac7b-b838-4544-8d48-1305646e1871 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:40.505539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f7e5ac7b-b838-4544-8d48-1305646e1871 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:40.512718 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7e5ac7b-b838-4544-8d48-1305646e1871 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:40.513163 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7e5ac7b-b838-4544-8d48-1305646e1871 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:40.513964 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7e5ac7b-b838-4544-8d48-1305646e1871 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:40.514388 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f7e5ac7b-b838-4544-8d48-1305646e1871 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:40.652213 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f7e5ac7b-b838-4544-8d48-1305646e1871 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:40.660454 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f7e5ac7b-b838-4544-8d48-1305646e1871 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:40.661982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f7e5ac7b-b838-4544-8d48-1305646e1871 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:40.663780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f7e5ac7b-b838-4544-8d48-1305646e1871 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1408 microversion: 2.20 time: 0.162695 Apr 12 14:58:40.664638 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 308/623] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:40 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:40.706101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1919060218", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6cdec854-4846-4896-ad7e-f14d9793db5b"}], "security_groups": [{"name": "tempest-securitygroup--2017986728"}], "key_name": "tempest-keypair-1876850993", "user_data": "}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:40.810082 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] validate_networks() for [('6cdec854-4846-4896-ad7e-f14d9793db5b', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:58:41.167707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:58:41.168083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:58:41.168581 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:58:41.168989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:58:41.169396 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:58:41.178739 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:41.179373 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:41.180171 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:41.180604 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:41.197156 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:58:41.201293 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Getting quotas for user d317bfa69daa49f286fd8c216e9f415a and project 39fcc2a0fdd24f72a683109da0ad023e. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:58:41.212203 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:58:41.214579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:58:41.346012 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-af8a0174-767b-471e-98ee-8dc10a572635 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.644416 Apr 12 14:58:41.346866 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 316/624] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:58:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:58:41.361041 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-11b2f9ee-f172-4b25-9fe8-0cf87090859d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:41.362746 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-11b2f9ee-f172-4b25-9fe8-0cf87090859d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:41.419311 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-11b2f9ee-f172-4b25-9fe8-0cf87090859d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:41.426710 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-11b2f9ee-f172-4b25-9fe8-0cf87090859d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1238 microversion: 2.1 time: 0.069531 Apr 12 14:58:41.427283 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 309/625] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:41 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:41.682513 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5ca4a968-f3fc-4618-b61b-b2c2947a1c76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:41.683125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5ca4a968-f3fc-4618-b61b-b2c2947a1c76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:41.689252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ca4a968-f3fc-4618-b61b-b2c2947a1c76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:41.689737 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ca4a968-f3fc-4618-b61b-b2c2947a1c76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:41.690511 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ca4a968-f3fc-4618-b61b-b2c2947a1c76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:41.690949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5ca4a968-f3fc-4618-b61b-b2c2947a1c76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:41.821037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5ca4a968-f3fc-4618-b61b-b2c2947a1c76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:41.829303 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5ca4a968-f3fc-4618-b61b-b2c2947a1c76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:41.830914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5ca4a968-f3fc-4618-b61b-b2c2947a1c76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:41.832092 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5ca4a968-f3fc-4618-b61b-b2c2947a1c76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1408 microversion: 2.20 time: 0.154278 Apr 12 14:58:41.832795 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 317/626] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:41 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:42.444521 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5f919c8e-4dda-49cd-89b3-9272454b085a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:42.445144 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5f919c8e-4dda-49cd-89b3-9272454b085a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:42.452400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5f919c8e-4dda-49cd-89b3-9272454b085a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:42.452841 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5f919c8e-4dda-49cd-89b3-9272454b085a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:42.453596 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5f919c8e-4dda-49cd-89b3-9272454b085a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:42.454189 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5f919c8e-4dda-49cd-89b3-9272454b085a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:42.515177 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5f919c8e-4dda-49cd-89b3-9272454b085a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:42.522696 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5f919c8e-4dda-49cd-89b3-9272454b085a tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1234 microversion: 2.1 time: 0.082230 Apr 12 14:58:42.523259 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 310/627] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:42 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1234 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:42.851032 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dd252bcd-b47b-42e2-b883-d4abd6960c22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:42.851634 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dd252bcd-b47b-42e2-b883-d4abd6960c22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:42.857885 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd252bcd-b47b-42e2-b883-d4abd6960c22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:42.858332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd252bcd-b47b-42e2-b883-d4abd6960c22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:42.859089 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd252bcd-b47b-42e2-b883-d4abd6960c22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:42.859544 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd252bcd-b47b-42e2-b883-d4abd6960c22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:43.005890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd252bcd-b47b-42e2-b883-d4abd6960c22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:43.014296 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd252bcd-b47b-42e2-b883-d4abd6960c22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:43.015810 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd252bcd-b47b-42e2-b883-d4abd6960c22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:43.016919 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dd252bcd-b47b-42e2-b883-d4abd6960c22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1408 microversion: 2.20 time: 0.170895 Apr 12 14:58:43.017718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 318/628] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:42 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:43.541323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-eae8de8b-650d-494d-9236-4af0305c7986 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:43.542039 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-eae8de8b-650d-494d-9236-4af0305c7986 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:43.548727 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eae8de8b-650d-494d-9236-4af0305c7986 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:43.549174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eae8de8b-650d-494d-9236-4af0305c7986 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:43.549985 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eae8de8b-650d-494d-9236-4af0305c7986 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:43.550412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eae8de8b-650d-494d-9236-4af0305c7986 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:43.662065 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-eae8de8b-650d-494d-9236-4af0305c7986 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:43.670529 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-eae8de8b-650d-494d-9236-4af0305c7986 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1308 microversion: 2.1 time: 0.134317 Apr 12 14:58:43.671613 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 311/629] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:43 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:44.036240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ca40920d-3055-4b9e-85ba-6d5acf4ef023 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:44.036891 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ca40920d-3055-4b9e-85ba-6d5acf4ef023 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:44.044814 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca40920d-3055-4b9e-85ba-6d5acf4ef023 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:44.045259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca40920d-3055-4b9e-85ba-6d5acf4ef023 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:44.046303 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca40920d-3055-4b9e-85ba-6d5acf4ef023 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:44.046731 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca40920d-3055-4b9e-85ba-6d5acf4ef023 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:44.187210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ca40920d-3055-4b9e-85ba-6d5acf4ef023 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:44.194702 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ca40920d-3055-4b9e-85ba-6d5acf4ef023 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:44.196231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ca40920d-3055-4b9e-85ba-6d5acf4ef023 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:44.197344 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ca40920d-3055-4b9e-85ba-6d5acf4ef023 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1408 microversion: 2.20 time: 0.165582 Apr 12 14:58:44.198123 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 319/630] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:44 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:58:44.688477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-88ab3744-5d2d-4efa-8be2-125d70b6cbd0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:44.689083 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-88ab3744-5d2d-4efa-8be2-125d70b6cbd0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:44.696721 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88ab3744-5d2d-4efa-8be2-125d70b6cbd0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:44.697446 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88ab3744-5d2d-4efa-8be2-125d70b6cbd0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:44.698833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88ab3744-5d2d-4efa-8be2-125d70b6cbd0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:44.699452 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88ab3744-5d2d-4efa-8be2-125d70b6cbd0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:44.854102 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-88ab3744-5d2d-4efa-8be2-125d70b6cbd0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:44.861295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-88ab3744-5d2d-4efa-8be2-125d70b6cbd0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1364 microversion: 2.1 time: 0.176801 Apr 12 14:58:44.861893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 312/631] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:44 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:44.951572 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-106e6cff-884f-4305-895b-c0a6908040d6 req-62ac4ef8-0736-4435-9126-1deb4ae59474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91be4b61-f6fb-4860-9346-f172a57ce12a", "tag": "95cec772-b36b-4db9-bc7d-ba457a268029"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:44.962970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-106e6cff-884f-4305-895b-c0a6908040d6 req-62ac4ef8-0736-4435-9126-1deb4ae59474 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:44.963372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-106e6cff-884f-4305-895b-c0a6908040d6 req-62ac4ef8-0736-4435-9126-1deb4ae59474 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:44.976138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-106e6cff-884f-4305-895b-c0a6908040d6 req-62ac4ef8-0736-4435-9126-1deb4ae59474 service nova] Creating event network-changed:95cec772-b36b-4db9-bc7d-ba457a268029 for instance 91be4b61-f6fb-4860-9346-f172a57ce12a on hv-cinder-83752 Apr 12 14:58:44.981294 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-106e6cff-884f-4305-895b-c0a6908040d6 req-62ac4ef8-0736-4435-9126-1deb4ae59474 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037557 Apr 12 14:58:44.982010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 320/632] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:45.159244 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-6a0321bd-c153-4d68-918a-e0ee204e2912 req-2ca36450-9017-4d41-91bd-99e25be80dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946d8ea7-5cb9-4e2f-99b4-27f342c44b63", "name": "network-vif-plugged", "status": "completed", "tag": "5c58da46-e5bb-4b4a-8051-745b00e75ae2"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:45.169326 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6a0321bd-c153-4d68-918a-e0ee204e2912 req-2ca36450-9017-4d41-91bd-99e25be80dc2 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:45.169879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6a0321bd-c153-4d68-918a-e0ee204e2912 req-2ca36450-9017-4d41-91bd-99e25be80dc2 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:45.183658 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-6a0321bd-c153-4d68-918a-e0ee204e2912 req-2ca36450-9017-4d41-91bd-99e25be80dc2 service nova] Creating event network-vif-plugged:5c58da46-e5bb-4b4a-8051-745b00e75ae2 for instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 on hv-cinder-83752 Apr 12 14:58:45.188729 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-6a0321bd-c153-4d68-918a-e0ee204e2912 req-2ca36450-9017-4d41-91bd-99e25be80dc2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033761 Apr 12 14:58:45.189333 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 313/633] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:45.217076 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e6cc3ff6-4a50-47a0-8748-39696fb45509 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:45.217816 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e6cc3ff6-4a50-47a0-8748-39696fb45509 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:45.224169 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e6cc3ff6-4a50-47a0-8748-39696fb45509 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:45.224650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e6cc3ff6-4a50-47a0-8748-39696fb45509 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:45.225620 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e6cc3ff6-4a50-47a0-8748-39696fb45509 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:45.226303 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e6cc3ff6-4a50-47a0-8748-39696fb45509 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:45.379936 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e6cc3ff6-4a50-47a0-8748-39696fb45509 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:45.389617 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e6cc3ff6-4a50-47a0-8748-39696fb45509 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:45.391464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e6cc3ff6-4a50-47a0-8748-39696fb45509 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:45.392676 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e6cc3ff6-4a50-47a0-8748-39696fb45509 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1408 microversion: 2.20 time: 0.180399 Apr 12 14:58:45.393298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 321/634] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:45 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:45.883559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2812d708-da2e-41bc-a1e2-448b399a9b4b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:45.884175 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2812d708-da2e-41bc-a1e2-448b399a9b4b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:45.890168 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2812d708-da2e-41bc-a1e2-448b399a9b4b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:45.890612 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2812d708-da2e-41bc-a1e2-448b399a9b4b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:45.891376 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2812d708-da2e-41bc-a1e2-448b399a9b4b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:45.891805 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2812d708-da2e-41bc-a1e2-448b399a9b4b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:46.025132 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2812d708-da2e-41bc-a1e2-448b399a9b4b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:46.032589 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2812d708-da2e-41bc-a1e2-448b399a9b4b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1364 microversion: 2.1 time: 0.154056 Apr 12 14:58:46.033145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 314/635] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:45 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:46.413004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-230e86dc-05c5-4f6f-85c0-da1318b386a3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:46.413758 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-230e86dc-05c5-4f6f-85c0-da1318b386a3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:46.420978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-230e86dc-05c5-4f6f-85c0-da1318b386a3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:46.421498 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-230e86dc-05c5-4f6f-85c0-da1318b386a3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:46.422425 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-230e86dc-05c5-4f6f-85c0-da1318b386a3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:46.422917 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-230e86dc-05c5-4f6f-85c0-da1318b386a3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:46.562461 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-230e86dc-05c5-4f6f-85c0-da1318b386a3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:46.563857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-230e86dc-05c5-4f6f-85c0-da1318b386a3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:46.565345 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-230e86dc-05c5-4f6f-85c0-da1318b386a3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:46.566468 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-230e86dc-05c5-4f6f-85c0-da1318b386a3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1408 microversion: 2.20 time: 0.158293 Apr 12 14:58:46.567028 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 322/636] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:46 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:47.056190 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c1b193b5-c04e-4e1f-8df1-b5f0b892e088 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:47.056806 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c1b193b5-c04e-4e1f-8df1-b5f0b892e088 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:47.063160 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1b193b5-c04e-4e1f-8df1-b5f0b892e088 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:47.063612 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1b193b5-c04e-4e1f-8df1-b5f0b892e088 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:47.064428 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1b193b5-c04e-4e1f-8df1-b5f0b892e088 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:47.064861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c1b193b5-c04e-4e1f-8df1-b5f0b892e088 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:47.194368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c1b193b5-c04e-4e1f-8df1-b5f0b892e088 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:47.206857 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c1b193b5-c04e-4e1f-8df1-b5f0b892e088 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1364 microversion: 2.1 time: 0.154188 Apr 12 14:58:47.207781 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 315/637] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:47 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:47.584631 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c9ebd208-c73e-4a31-be0a-8b6b32e0685e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:47.585249 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c9ebd208-c73e-4a31-be0a-8b6b32e0685e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:47.592400 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9ebd208-c73e-4a31-be0a-8b6b32e0685e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:47.592849 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9ebd208-c73e-4a31-be0a-8b6b32e0685e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:47.593624 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9ebd208-c73e-4a31-be0a-8b6b32e0685e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:47.594082 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9ebd208-c73e-4a31-be0a-8b6b32e0685e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:47.730900 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c9ebd208-c73e-4a31-be0a-8b6b32e0685e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:47.742433 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c9ebd208-c73e-4a31-be0a-8b6b32e0685e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:47.744332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c9ebd208-c73e-4a31-be0a-8b6b32e0685e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:47.745683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c9ebd208-c73e-4a31-be0a-8b6b32e0685e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1408 microversion: 2.20 time: 0.165133 Apr 12 14:58:47.746445 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 323/638] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:47 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:48.229353 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-926d64fb-9ea7-4685-87c5-2a6644a63c31 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:48.230016 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-926d64fb-9ea7-4685-87c5-2a6644a63c31 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:48.237448 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-926d64fb-9ea7-4685-87c5-2a6644a63c31 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:48.238008 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-926d64fb-9ea7-4685-87c5-2a6644a63c31 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:48.238808 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-926d64fb-9ea7-4685-87c5-2a6644a63c31 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:48.239235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-926d64fb-9ea7-4685-87c5-2a6644a63c31 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:48.375488 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-926d64fb-9ea7-4685-87c5-2a6644a63c31 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:48.385123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-926d64fb-9ea7-4685-87c5-2a6644a63c31 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1364 microversion: 2.1 time: 0.160286 Apr 12 14:58:48.385735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 316/639] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:48 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:48.764533 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e907ef3a-b104-4da1-a322-4f5a05e57beb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:48.765158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e907ef3a-b104-4da1-a322-4f5a05e57beb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:48.771493 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e907ef3a-b104-4da1-a322-4f5a05e57beb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:48.771935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e907ef3a-b104-4da1-a322-4f5a05e57beb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:48.772698 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e907ef3a-b104-4da1-a322-4f5a05e57beb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:48.773128 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e907ef3a-b104-4da1-a322-4f5a05e57beb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:48.920669 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e907ef3a-b104-4da1-a322-4f5a05e57beb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:48.930197 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e907ef3a-b104-4da1-a322-4f5a05e57beb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:48.931756 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e907ef3a-b104-4da1-a322-4f5a05e57beb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:48.932936 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e907ef3a-b104-4da1-a322-4f5a05e57beb tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1600 microversion: 2.20 time: 0.172336 Apr 12 14:58:48.933506 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 324/640] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:58:48 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:58:48.959356 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bd9a744c-9a2c-4e71-b750-da43e3c364cd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:48.959995 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bd9a744c-9a2c-4e71-b750-da43e3c364cd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:48.967250 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd9a744c-9a2c-4e71-b750-da43e3c364cd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:48.967793 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd9a744c-9a2c-4e71-b750-da43e3c364cd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:48.968763 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd9a744c-9a2c-4e71-b750-da43e3c364cd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:48.969296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd9a744c-9a2c-4e71-b750-da43e3c364cd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:49.068633 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bd9a744c-9a2c-4e71-b750-da43e3c364cd tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.114554 Apr 12 14:58:49.069411 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 317/641] 10.222.0.64 () {60 vars in 1315 bytes} [Tue Apr 12 14:58:48 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 14:58:49.403330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-20c479cc-7705-4eb4-91d1-435aaf3df755 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:49.403856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-20c479cc-7705-4eb4-91d1-435aaf3df755 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:49.410280 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20c479cc-7705-4eb4-91d1-435aaf3df755 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:49.410721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20c479cc-7705-4eb4-91d1-435aaf3df755 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:49.411495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20c479cc-7705-4eb4-91d1-435aaf3df755 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:49.412602 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20c479cc-7705-4eb4-91d1-435aaf3df755 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:49.587798 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-20c479cc-7705-4eb4-91d1-435aaf3df755 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:49.595973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-20c479cc-7705-4eb4-91d1-435aaf3df755 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1364 microversion: 2.1 time: 0.196569 Apr 12 14:58:49.596804 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 325/642] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:49 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:50.414711 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-bb7ce38a-5fae-4a97-a6eb-6db089947d84 req-428cc298-a6c3-49fa-b34c-c7d09355f78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946d8ea7-5cb9-4e2f-99b4-27f342c44b63", "tag": "5c58da46-e5bb-4b4a-8051-745b00e75ae2"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:50.422761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-bb7ce38a-5fae-4a97-a6eb-6db089947d84 req-428cc298-a6c3-49fa-b34c-c7d09355f78a service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:50.423196 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-bb7ce38a-5fae-4a97-a6eb-6db089947d84 req-428cc298-a6c3-49fa-b34c-c7d09355f78a service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:50.434843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-bb7ce38a-5fae-4a97-a6eb-6db089947d84 req-428cc298-a6c3-49fa-b34c-c7d09355f78a service nova] Creating event network-changed:5c58da46-e5bb-4b4a-8051-745b00e75ae2 for instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 on hv-cinder-83752 Apr 12 14:58:50.439682 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-bb7ce38a-5fae-4a97-a6eb-6db089947d84 req-428cc298-a6c3-49fa-b34c-c7d09355f78a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029330 Apr 12 14:58:50.440601 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 318/643] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:50.617054 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-12f8e497-7954-4e96-9e38-5a99b987dc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:50.619933 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-12f8e497-7954-4e96-9e38-5a99b987dc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:50.628440 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-12f8e497-7954-4e96-9e38-5a99b987dc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:50.629096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-12f8e497-7954-4e96-9e38-5a99b987dc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:50.630311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-12f8e497-7954-4e96-9e38-5a99b987dc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:50.631027 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-12f8e497-7954-4e96-9e38-5a99b987dc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:50.784218 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-12f8e497-7954-4e96-9e38-5a99b987dc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:50.792621 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-12f8e497-7954-4e96-9e38-5a99b987dc6d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1364 microversion: 2.1 time: 0.182445 Apr 12 14:58:50.793544 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 326/644] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:50 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:51.439860 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-edda8699-1d8c-4aa1-a5d1-f30a2dedfc44 req-8f8d160d-02eb-4375-94a9-7558192a8685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91be4b61-f6fb-4860-9346-f172a57ce12a", "name": "network-vif-plugged", "status": "completed", "tag": "95cec772-b36b-4db9-bc7d-ba457a268029"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:51.449292 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-edda8699-1d8c-4aa1-a5d1-f30a2dedfc44 req-8f8d160d-02eb-4375-94a9-7558192a8685 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:51.449767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-edda8699-1d8c-4aa1-a5d1-f30a2dedfc44 req-8f8d160d-02eb-4375-94a9-7558192a8685 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:51.467693 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-edda8699-1d8c-4aa1-a5d1-f30a2dedfc44 req-8f8d160d-02eb-4375-94a9-7558192a8685 service nova] Creating event network-vif-plugged:95cec772-b36b-4db9-bc7d-ba457a268029 for instance 91be4b61-f6fb-4860-9346-f172a57ce12a on hv-cinder-83752 Apr 12 14:58:51.476074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-edda8699-1d8c-4aa1-a5d1-f30a2dedfc44 req-8f8d160d-02eb-4375-94a9-7558192a8685 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038433 Apr 12 14:58:51.476074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 319/645] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:51.813523 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bbd2a770-e7d6-42f7-a8ae-43df05d6f1d0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:51.816810 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bbd2a770-e7d6-42f7-a8ae-43df05d6f1d0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:51.826332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bbd2a770-e7d6-42f7-a8ae-43df05d6f1d0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:51.826776 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bbd2a770-e7d6-42f7-a8ae-43df05d6f1d0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:51.827664 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bbd2a770-e7d6-42f7-a8ae-43df05d6f1d0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:51.828161 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bbd2a770-e7d6-42f7-a8ae-43df05d6f1d0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:51.996635 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bbd2a770-e7d6-42f7-a8ae-43df05d6f1d0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:52.004945 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bbd2a770-e7d6-42f7-a8ae-43df05d6f1d0 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1364 microversion: 2.1 time: 0.195952 Apr 12 14:58:52.005530 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 327/646] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:51 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:53.025131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2580aa2f-f5ea-4751-b2da-7121dfb94c43 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:53.025870 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2580aa2f-f5ea-4751-b2da-7121dfb94c43 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:53.032624 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2580aa2f-f5ea-4751-b2da-7121dfb94c43 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:53.033075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2580aa2f-f5ea-4751-b2da-7121dfb94c43 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:53.033882 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2580aa2f-f5ea-4751-b2da-7121dfb94c43 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:53.034318 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2580aa2f-f5ea-4751-b2da-7121dfb94c43 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:53.164097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2580aa2f-f5ea-4751-b2da-7121dfb94c43 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:53.172258 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2580aa2f-f5ea-4751-b2da-7121dfb94c43 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1364 microversion: 2.1 time: 0.152449 Apr 12 14:58:53.172863 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 320/647] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:53 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:58:54.192648 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f5327bf0-f459-4993-986a-0424006b11fe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:54.193531 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f5327bf0-f459-4993-986a-0424006b11fe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:54.200095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f5327bf0-f459-4993-986a-0424006b11fe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:54.200539 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f5327bf0-f459-4993-986a-0424006b11fe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:54.201340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f5327bf0-f459-4993-986a-0424006b11fe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:54.201806 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f5327bf0-f459-4993-986a-0424006b11fe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:54.342728 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f5327bf0-f459-4993-986a-0424006b11fe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:58:54.351987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f5327bf0-f459-4993-986a-0424006b11fe tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1550 microversion: 2.1 time: 0.163191 Apr 12 14:58:54.352558 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 328/648] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:58:54 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:58:54.371587 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ea9b8113-bced-4f60-9206-6dd2a669c143 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:54.372107 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ea9b8113-bced-4f60-9206-6dd2a669c143 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:54.378434 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea9b8113-bced-4f60-9206-6dd2a669c143 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:54.378910 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea9b8113-bced-4f60-9206-6dd2a669c143 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:54.379673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea9b8113-bced-4f60-9206-6dd2a669c143 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:54.380107 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea9b8113-bced-4f60-9206-6dd2a669c143 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:54.457706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ea9b8113-bced-4f60-9206-6dd2a669c143 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090017 Apr 12 14:58:54.458446 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 321/649] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Apr 12 14:58:54 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:58:55.760330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-8ac407c7-6695-40f6-96b6-e3a075507124 req-5480eb42-b69f-424e-aa93-7e56024e451a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91be4b61-f6fb-4860-9346-f172a57ce12a", "tag": "95cec772-b36b-4db9-bc7d-ba457a268029"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:55.766109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-8ac407c7-6695-40f6-96b6-e3a075507124 req-5480eb42-b69f-424e-aa93-7e56024e451a service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:55.766546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-8ac407c7-6695-40f6-96b6-e3a075507124 req-5480eb42-b69f-424e-aa93-7e56024e451a service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:55.779113 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-8ac407c7-6695-40f6-96b6-e3a075507124 req-5480eb42-b69f-424e-aa93-7e56024e451a service nova] Creating event network-changed:95cec772-b36b-4db9-bc7d-ba457a268029 for instance 91be4b61-f6fb-4860-9346-f172a57ce12a on hv-cinder-83752 Apr 12 14:58:55.784241 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-8ac407c7-6695-40f6-96b6-e3a075507124 req-5480eb42-b69f-424e-aa93-7e56024e451a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031431 Apr 12 14:58:55.784939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 329/650] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:58:57.920833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-21441009-6d63-4c94-85ff-e5a9bf1d711a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:58:57.921423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-21441009-6d63-4c94-85ff-e5a9bf1d711a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:57.927131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21441009-6d63-4c94-85ff-e5a9bf1d711a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:57.927814 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21441009-6d63-4c94-85ff-e5a9bf1d711a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:57.928606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21441009-6d63-4c94-85ff-e5a9bf1d711a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:57.929026 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21441009-6d63-4c94-85ff-e5a9bf1d711a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:57.952695 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-21441009-6d63-4c94-85ff-e5a9bf1d711a tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/ips" status: 200 len: 147 microversion: 2.1 time: 0.036028 Apr 12 14:58:57.953300 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 322/651] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Apr 12 14:58:57 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:58:59.632783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-53a85aff-ee50-42a0-8f98-318a1b13cee1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "412ec722-c2c0-4c4d-887c-872f7bcd028b"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:58:59.633946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-53a85aff-ee50-42a0-8f98-318a1b13cee1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:58:59.640108 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53a85aff-ee50-42a0-8f98-318a1b13cee1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:59.640553 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53a85aff-ee50-42a0-8f98-318a1b13cee1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:58:59.641322 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53a85aff-ee50-42a0-8f98-318a1b13cee1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:58:59.641779 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53a85aff-ee50-42a0-8f98-318a1b13cee1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:00.491256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-53a85aff-ee50-42a0-8f98-318a1b13cee1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863221 Apr 12 14:59:00.492076 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 330/652] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 14:58:59 2022] POST /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments => generated 194 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:09.051745 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a98a2a44-8c21-4355-bf42-d1861f0b8bab tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "412ec722-c2c0-4c4d-887c-872f7bcd028b"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:09.053503 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a98a2a44-8c21-4355-bf42-d1861f0b8bab tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:09.060221 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a98a2a44-8c21-4355-bf42-d1861f0b8bab tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:09.060665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a98a2a44-8c21-4355-bf42-d1861f0b8bab tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:09.061432 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a98a2a44-8c21-4355-bf42-d1861f0b8bab tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:09.061892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a98a2a44-8c21-4355-bf42-d1861f0b8bab tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:09.145596 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-a98a2a44-8c21-4355-bf42-d1861f0b8bab tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Invalid volume: volume 412ec722-c2c0-4c4d-887c-872f7bcd028b is already attached to instances: ae131a2b-c453-4c6c-b640-61daffe8c005 Apr 12 14:59:09.146354 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a98a2a44-8c21-4355-bf42-d1861f0b8bab tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 400 to user: Invalid volume: volume 412ec722-c2c0-4c4d-887c-872f7bcd028b is already attached to instances: ae131a2b-c453-4c6c-b640-61daffe8c005 {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:09.147198 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a98a2a44-8c21-4355-bf42-d1861f0b8bab tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100258 Apr 12 14:59:09.147761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 323/653] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 14:59:09 2022] POST /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 14:59:09.209095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9e8a3bcb-4611-4e0e-bc03-594b0ba0c088 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:09.209644 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9e8a3bcb-4611-4e0e-bc03-594b0ba0c088 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:09.215818 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9e8a3bcb-4611-4e0e-bc03-594b0ba0c088 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:09.216269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9e8a3bcb-4611-4e0e-bc03-594b0ba0c088 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:09.217040 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9e8a3bcb-4611-4e0e-bc03-594b0ba0c088 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:09.217474 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9e8a3bcb-4611-4e0e-bc03-594b0ba0c088 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:09.298344 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-9e8a3bcb-4611-4e0e-bc03-594b0ba0c088 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lazy-loading 'services' on Instance uuid ae131a2b-c453-4c6c-b640-61daffe8c005 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:59:09.510070 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9e8a3bcb-4611-4e0e-bc03-594b0ba0c088 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments/412ec722-c2c0-4c4d-887c-872f7bcd028b" status: 202 len: 0 microversion: 2.1 time: 0.305804 Apr 12 14:59:09.510631 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 331/654] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Apr 12 14:59:09 2022] DELETE /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments/412ec722-c2c0-4c4d-887c-872f7bcd028b => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:59:09.519095 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2b4c42c3-e366-4d18-94b5-a002b33a04a1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:09.520195 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2b4c42c3-e366-4d18-94b5-a002b33a04a1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:09.527309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b4c42c3-e366-4d18-94b5-a002b33a04a1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:09.527748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b4c42c3-e366-4d18-94b5-a002b33a04a1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:09.528511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b4c42c3-e366-4d18-94b5-a002b33a04a1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:09.528936 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b4c42c3-e366-4d18-94b5-a002b33a04a1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:09.559509 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2b4c42c3-e366-4d18-94b5-a002b33a04a1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Apr 12 14:59:09.560110 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 324/655] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:59:09 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:10.571646 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-18ca20c2-08c0-4c80-9a68-b1db1d4fdfde tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:10.572916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-18ca20c2-08c0-4c80-9a68-b1db1d4fdfde tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:10.579194 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18ca20c2-08c0-4c80-9a68-b1db1d4fdfde tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:10.579639 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18ca20c2-08c0-4c80-9a68-b1db1d4fdfde tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:10.580417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18ca20c2-08c0-4c80-9a68-b1db1d4fdfde tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:10.580849 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18ca20c2-08c0-4c80-9a68-b1db1d4fdfde tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:10.611322 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-18ca20c2-08c0-4c80-9a68-b1db1d4fdfde tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Apr 12 14:59:10.611889 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 332/656] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:59:10 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:11.623834 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9ba91d29-a111-4dfd-908f-2a6a92fa9c07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:11.624655 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9ba91d29-a111-4dfd-908f-2a6a92fa9c07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:11.631823 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ba91d29-a111-4dfd-908f-2a6a92fa9c07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:11.632261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ba91d29-a111-4dfd-908f-2a6a92fa9c07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:11.633019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ba91d29-a111-4dfd-908f-2a6a92fa9c07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:11.633456 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ba91d29-a111-4dfd-908f-2a6a92fa9c07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:11.661662 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9ba91d29-a111-4dfd-908f-2a6a92fa9c07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042123 Apr 12 14:59:11.662211 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 325/657] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:59:11 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 14:59:11.724521 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-08cb2c9c-9332-44b5-9055-ecc9bb8e0e9e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:11.725066 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-08cb2c9c-9332-44b5-9055-ecc9bb8e0e9e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:11.731374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-08cb2c9c-9332-44b5-9055-ecc9bb8e0e9e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:11.731817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-08cb2c9c-9332-44b5-9055-ecc9bb8e0e9e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:11.732742 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-08cb2c9c-9332-44b5-9055-ecc9bb8e0e9e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:11.733022 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-08cb2c9c-9332-44b5-9055-ecc9bb8e0e9e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:11.759019 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-08cb2c9c-9332-44b5-9055-ecc9bb8e0e9e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 14:59:12.110152 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-08cb2c9c-9332-44b5-9055-ecc9bb8e0e9e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 204 len: 0 microversion: 2.1 time: 0.389093 Apr 12 14:59:12.110743 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 333/658] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 14:59:11 2022] DELETE /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 14:59:12.119267 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-957ee5f4-df54-4a27-9331-a8739a14879c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:12.119872 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-957ee5f4-df54-4a27-9331-a8739a14879c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:12.125885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-957ee5f4-df54-4a27-9331-a8739a14879c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:12.126327 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-957ee5f4-df54-4a27-9331-a8739a14879c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:12.127085 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-957ee5f4-df54-4a27-9331-a8739a14879c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:12.127513 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-957ee5f4-df54-4a27-9331-a8739a14879c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:12.258628 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-957ee5f4-df54-4a27-9331-a8739a14879c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:12.266150 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-957ee5f4-df54-4a27-9331-a8739a14879c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1674 microversion: 2.1 time: 0.150803 Apr 12 14:59:12.266709 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 326/659] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:12 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:13.284706 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-234d3f26-9219-4f5a-9932-a060b2d3d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:13.285407 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-234d3f26-9219-4f5a-9932-a060b2d3d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:13.292503 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-234d3f26-9219-4f5a-9932-a060b2d3d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:13.292947 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-234d3f26-9219-4f5a-9932-a060b2d3d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:13.293744 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-234d3f26-9219-4f5a-9932-a060b2d3d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:13.294177 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-234d3f26-9219-4f5a-9932-a060b2d3d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:13.424877 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-234d3f26-9219-4f5a-9932-a060b2d3d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:13.432954 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-234d3f26-9219-4f5a-9932-a060b2d3d938 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1674 microversion: 2.1 time: 0.152544 Apr 12 14:59:13.435356 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 334/660] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:13 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:14.451064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6227db62-9365-4071-9ae2-d1e833e0978d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:14.451830 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6227db62-9365-4071-9ae2-d1e833e0978d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:14.459822 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6227db62-9365-4071-9ae2-d1e833e0978d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:14.460271 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6227db62-9365-4071-9ae2-d1e833e0978d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:14.461042 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6227db62-9365-4071-9ae2-d1e833e0978d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:14.461470 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6227db62-9365-4071-9ae2-d1e833e0978d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:14.665154 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6227db62-9365-4071-9ae2-d1e833e0978d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:14.673238 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6227db62-9365-4071-9ae2-d1e833e0978d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1674 microversion: 2.1 time: 0.226641 Apr 12 14:59:14.673842 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 327/661] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:14 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1674 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:15.027957 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-7e6faa2e-1c88-49c3-b3f1-28a861896d62 req-fe2ed6ac-75d4-49e7-b09f-f2ea54424e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae131a2b-c453-4c6c-b640-61daffe8c005", "name": "network-vif-deleted", "tag": "0234a853-b13d-45b5-b98f-e584074a2235"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:15.037321 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-7e6faa2e-1c88-49c3-b3f1-28a861896d62 req-fe2ed6ac-75d4-49e7-b09f-f2ea54424e15 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:15.037811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-7e6faa2e-1c88-49c3-b3f1-28a861896d62 req-fe2ed6ac-75d4-49e7-b09f-f2ea54424e15 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:15.050522 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-7e6faa2e-1c88-49c3-b3f1-28a861896d62 req-fe2ed6ac-75d4-49e7-b09f-f2ea54424e15 service nova] Creating event network-vif-deleted:0234a853-b13d-45b5-b98f-e584074a2235 for instance ae131a2b-c453-4c6c-b640-61daffe8c005 on hv-cinder-83752 Apr 12 14:59:15.062657 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-7e6faa2e-1c88-49c3-b3f1-28a861896d62 req-fe2ed6ac-75d4-49e7-b09f-f2ea54424e15 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037701 Apr 12 14:59:15.063605 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 335/662] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:15.387002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-51bc137e-ba56-4da5-8d07-cec850de8a42 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:15.387491 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-51bc137e-ba56-4da5-8d07-cec850de8a42 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:15.393520 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51bc137e-ba56-4da5-8d07-cec850de8a42 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:15.394012 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51bc137e-ba56-4da5-8d07-cec850de8a42 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:15.394787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51bc137e-ba56-4da5-8d07-cec850de8a42 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:15.395215 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-51bc137e-ba56-4da5-8d07-cec850de8a42 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:15.497315 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-51bc137e-ba56-4da5-8d07-cec850de8a42 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lazy-loading 'services' on Instance uuid dfd692aa-e03c-4686-8512-e5b6d426893f {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:59:15.693120 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:15.693120 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:15.702380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:15.702989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:15.703691 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:15.706787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:15.743463 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:15.744217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:15.744462 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-51bc137e-ba56-4da5-8d07-cec850de8a42 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "DELETE /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments/41d810ab-a6f6-44c7-b504-cbdadfbf3aa9" status: 202 len: 0 microversion: 2.1 time: 0.360748 Apr 12 14:59:15.757522 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lazy-loading 'fault' on Instance uuid ae131a2b-c453-4c6c-b640-61daffe8c005 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:59:15.757700 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 328/663] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Apr 12 14:59:15 2022] DELETE /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments/41d810ab-a6f6-44c7-b504-cbdadfbf3aa9 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:59:15.769783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-207f46cd-a37a-4974-b2e7-4d1bef366288 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:15.773805 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-207f46cd-a37a-4974-b2e7-4d1bef366288 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:15.780440 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-207f46cd-a37a-4974-b2e7-4d1bef366288 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:15.780900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-207f46cd-a37a-4974-b2e7-4d1bef366288 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:15.781712 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-207f46cd-a37a-4974-b2e7-4d1bef366288 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:15.782170 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-207f46cd-a37a-4974-b2e7-4d1bef366288 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:15.813968 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-207f46cd-a37a-4974-b2e7-4d1bef366288 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056348 Apr 12 14:59:15.814535 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 329/664] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:59:15 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:15.858285 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:15.867548 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fc3896db-9c22-4c51-a4d5-1694a8674aa3 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 200 len: 1326 microversion: 2.1 time: 0.179386 Apr 12 14:59:15.868142 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 336/665] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:15 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 1326 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:59:16.826541 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-83088231-0cbe-4f6e-b4ff-37541c6db12d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:16.827375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-83088231-0cbe-4f6e-b4ff-37541c6db12d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:16.834343 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83088231-0cbe-4f6e-b4ff-37541c6db12d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:16.834789 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83088231-0cbe-4f6e-b4ff-37541c6db12d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:16.835559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83088231-0cbe-4f6e-b4ff-37541c6db12d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:16.835991 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-83088231-0cbe-4f6e-b4ff-37541c6db12d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:16.864452 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-83088231-0cbe-4f6e-b4ff-37541c6db12d tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042226 Apr 12 14:59:16.865028 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 330/666] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:59:16 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:16.884929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d24602e2-f6fe-4ab9-a6c5-95bb13af91e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:16.885542 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d24602e2-f6fe-4ab9-a6c5-95bb13af91e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:16.891916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d24602e2-f6fe-4ab9-a6c5-95bb13af91e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:16.892366 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d24602e2-f6fe-4ab9-a6c5-95bb13af91e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:16.893138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d24602e2-f6fe-4ab9-a6c5-95bb13af91e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:16.893573 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d24602e2-f6fe-4ab9-a6c5-95bb13af91e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:16.908534 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-d24602e2-f6fe-4ab9-a6c5-95bb13af91e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance ae131a2b-c453-4c6c-b640-61daffe8c005 could not be found. Apr 12 14:59:16.909120 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d24602e2-f6fe-4ab9-a6c5-95bb13af91e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance ae131a2b-c453-4c6c-b640-61daffe8c005 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:16.909974 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d24602e2-f6fe-4ab9-a6c5-95bb13af91e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 404 len: 111 microversion: 2.1 time: 0.028903 Apr 12 14:59:16.916209 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 337/667] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:16 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:59:16.919695 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-71328890-6022-4a68-a580-0df4de7959af tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '.version_select at 0x7fbd608cfca0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:17.009112 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-71328890-6022-4a68-a580-0df4de7959af tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-69661964" status: 202 len: 0 microversion: 2.1 time: 0.093200 Apr 12 14:59:17.009764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 331/668] 10.222.0.64 () {58 vars in 1214 bytes} [Tue Apr 12 14:59:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-69661964 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:59:17.797774 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ae5e39b5-1db8-4fa2-8a8c-0c198f289845 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: .version_select at 0x7fbd60850e50>, body: {"keypair": {"name": "tempest-keypair-54207108"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:17.812082 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-ae5e39b5-1db8-4fa2-8a8c-0c198f289845 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:59:17.815895 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-ae5e39b5-1db8-4fa2-8a8c-0c198f289845 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:59:17.876701 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-841f1f22-2483-420a-9f50-0f558f3872bf tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:17.877611 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-841f1f22-2483-420a-9f50-0f558f3872bf tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:17.884331 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-841f1f22-2483-420a-9f50-0f558f3872bf tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:17.884787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-841f1f22-2483-420a-9f50-0f558f3872bf tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:17.885556 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-841f1f22-2483-420a-9f50-0f558f3872bf tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:17.886019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-841f1f22-2483-420a-9f50-0f558f3872bf tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:17.915184 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-841f1f22-2483-420a-9f50-0f558f3872bf tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042878 Apr 12 14:59:17.915752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 332/669] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:59:17 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 14:59:17.986580 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d6822607-99df-4c05-9471-c5e4ca06b883 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:17.987075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d6822607-99df-4c05-9471-c5e4ca06b883 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:17.993251 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6822607-99df-4c05-9471-c5e4ca06b883 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:17.993763 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6822607-99df-4c05-9471-c5e4ca06b883 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:17.994576 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6822607-99df-4c05-9471-c5e4ca06b883 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:17.995064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6822607-99df-4c05-9471-c5e4ca06b883 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:18.019044 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d6822607-99df-4c05-9471-c5e4ca06b883 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 14:59:18.194215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-ae5e39b5-1db8-4fa2-8a8c-0c198f289845 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:59:18.198341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-ae5e39b5-1db8-4fa2-8a8c-0c198f289845 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:59:18.211953 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ae5e39b5-1db8-4fa2-8a8c-0c198f289845 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.418094 Apr 12 14:59:18.212554 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 338/670] 10.222.0.64 () {60 vars in 1157 bytes} [Tue Apr 12 14:59:17 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:18.349914 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d6822607-99df-4c05-9471-c5e4ca06b883 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "DELETE /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 204 len: 0 microversion: 2.1 time: 0.366887 Apr 12 14:59:18.350516 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 333/671] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 14:59:17 2022] DELETE /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 14:59:18.358908 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2cc7588b-1b5e-47b3-bcde-988d8bde4c9b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:18.359508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2cc7588b-1b5e-47b3-bcde-988d8bde4c9b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:18.366250 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2cc7588b-1b5e-47b3-bcde-988d8bde4c9b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:18.366696 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2cc7588b-1b5e-47b3-bcde-988d8bde4c9b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:18.367465 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2cc7588b-1b5e-47b3-bcde-988d8bde4c9b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:18.367896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2cc7588b-1b5e-47b3-bcde-988d8bde4c9b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:18.504306 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2cc7588b-1b5e-47b3-bcde-988d8bde4c9b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:18.512356 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2cc7588b-1b5e-47b3-bcde-988d8bde4c9b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1688 microversion: 2.1 time: 0.157239 Apr 12 14:59:18.512936 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 339/672] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:18 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:59:19.529853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-49b6b5eb-4037-4d1e-84b7-21b2b4f63280 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:19.530556 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-49b6b5eb-4037-4d1e-84b7-21b2b4f63280 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:19.537510 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49b6b5eb-4037-4d1e-84b7-21b2b4f63280 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:19.537976 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49b6b5eb-4037-4d1e-84b7-21b2b4f63280 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:19.538758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49b6b5eb-4037-4d1e-84b7-21b2b4f63280 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:19.539183 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-49b6b5eb-4037-4d1e-84b7-21b2b4f63280 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:19.692084 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-49b6b5eb-4037-4d1e-84b7-21b2b4f63280 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:19.702222 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-49b6b5eb-4037-4d1e-84b7-21b2b4f63280 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1688 microversion: 2.1 time: 0.176651 Apr 12 14:59:19.702794 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 334/673] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:19 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:20.710034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1004901369", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc73a003-4067-4844-9c4d-7187574c0c62"}], "security_groups": [{"name": "tempest-securitygroup--261228252"}], "key_name": "tempest-keypair-54207108", "user_data": "}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:20.719925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-88fe38f4-b9a7-4c14-9615-28874718d071 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:20.721359 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-88fe38f4-b9a7-4c14-9615-28874718d071 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:20.727060 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88fe38f4-b9a7-4c14-9615-28874718d071 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:20.727574 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88fe38f4-b9a7-4c14-9615-28874718d071 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:20.728794 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88fe38f4-b9a7-4c14-9615-28874718d071 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:20.729820 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-88fe38f4-b9a7-4c14-9615-28874718d071 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:20.849594 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] validate_networks() for [('bc73a003-4067-4844-9c4d-7187574c0c62', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 14:59:20.949360 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-88fe38f4-b9a7-4c14-9615-28874718d071 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:20.956843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-88fe38f4-b9a7-4c14-9615-28874718d071 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1688 microversion: 2.1 time: 0.241384 Apr 12 14:59:20.957402 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 335/674] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:20 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1688 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:59:21.236093 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 14:59:21.236504 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 14:59:21.237000 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 14:59:21.237407 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 14:59:21.237849 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 14:59:21.246961 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:21.247397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:21.248189 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:21.248617 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:21.264956 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 14:59:21.268805 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Getting quotas for user b3ff63c087484d2db34665eb0ecc8430 and project d1b1cfd6536e4795874488a31e0d41d1. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 14:59:21.280547 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 14:59:21.282820 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 14:59:21.414204 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-14deb5ed-d7d8-43ab-8c36-c55e4c05a386 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.708353 Apr 12 14:59:21.414777 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 340/675] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 14:59:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 14:59:21.424667 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-213b80b2-3e51-4ee6-8051-0f69af10d8be tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:21.425286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-213b80b2-3e51-4ee6-8051-0f69af10d8be tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:21.483422 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-213b80b2-3e51-4ee6-8051-0f69af10d8be tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:21.490725 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-213b80b2-3e51-4ee6-8051-0f69af10d8be tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1240 microversion: 2.1 time: 0.069789 Apr 12 14:59:21.491309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 336/676] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:21 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:21.975943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f47e77da-ba34-4e85-9ff0-330bae80f399 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:21.976475 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f47e77da-ba34-4e85-9ff0-330bae80f399 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:21.982497 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f47e77da-ba34-4e85-9ff0-330bae80f399 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:21.982948 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f47e77da-ba34-4e85-9ff0-330bae80f399 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:21.983726 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f47e77da-ba34-4e85-9ff0-330bae80f399 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:21.984159 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f47e77da-ba34-4e85-9ff0-330bae80f399 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:22.138918 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f47e77da-ba34-4e85-9ff0-330bae80f399 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:22.148824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f47e77da-ba34-4e85-9ff0-330bae80f399 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1688 microversion: 2.1 time: 0.177396 Apr 12 14:59:22.150141 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 341/677] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:21 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:22.508014 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77da8a63-cb80-4da2-95ed-91924e3157e6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:22.508736 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-77da8a63-cb80-4da2-95ed-91924e3157e6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:22.517159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77da8a63-cb80-4da2-95ed-91924e3157e6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:22.517669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77da8a63-cb80-4da2-95ed-91924e3157e6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:22.522638 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77da8a63-cb80-4da2-95ed-91924e3157e6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:22.522638 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77da8a63-cb80-4da2-95ed-91924e3157e6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:22.594269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-77da8a63-cb80-4da2-95ed-91924e3157e6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:22.602690 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-77da8a63-cb80-4da2-95ed-91924e3157e6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1244 microversion: 2.1 time: 0.098838 Apr 12 14:59:22.603270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 337/678] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:22 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1244 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:23.102956 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-9da7720c-e7f1-4247-b068-8a599d655c4e req-d096ed06-d753-4a6e-baa7-0dc762304303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd692aa-e03c-4686-8512-e5b6d426893f", "name": "network-vif-deleted", "tag": "d0d6b7ba-aadc-4c5d-96b6-feb347509ccf"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:23.111329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-9da7720c-e7f1-4247-b068-8a599d655c4e req-d096ed06-d753-4a6e-baa7-0dc762304303 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:23.111770 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-9da7720c-e7f1-4247-b068-8a599d655c4e req-d096ed06-d753-4a6e-baa7-0dc762304303 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:23.123098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-9da7720c-e7f1-4247-b068-8a599d655c4e req-d096ed06-d753-4a6e-baa7-0dc762304303 service nova] Creating event network-vif-deleted:d0d6b7ba-aadc-4c5d-96b6-feb347509ccf for instance dfd692aa-e03c-4686-8512-e5b6d426893f on hv-cinder-83752 Apr 12 14:59:23.130142 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-9da7720c-e7f1-4247-b068-8a599d655c4e req-d096ed06-d753-4a6e-baa7-0dc762304303 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028713 Apr 12 14:59:23.130142 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 342/679] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:23.167218 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4805682d-a777-4223-bbb3-832f76aadc4c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:23.168473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4805682d-a777-4223-bbb3-832f76aadc4c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:23.174855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4805682d-a777-4223-bbb3-832f76aadc4c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:23.175320 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4805682d-a777-4223-bbb3-832f76aadc4c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:23.176109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4805682d-a777-4223-bbb3-832f76aadc4c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:23.177091 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4805682d-a777-4223-bbb3-832f76aadc4c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:23.265157 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4805682d-a777-4223-bbb3-832f76aadc4c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:23.274348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4805682d-a777-4223-bbb3-832f76aadc4c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 200 len: 1620 microversion: 2.1 time: 0.110968 Apr 12 14:59:23.280334 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 338/680] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:23 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 1620 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:23.620695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0f943f7a-3b60-46bc-9247-1cf725d9a03d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:23.621391 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0f943f7a-3b60-46bc-9247-1cf725d9a03d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:23.628162 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0f943f7a-3b60-46bc-9247-1cf725d9a03d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:23.628610 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0f943f7a-3b60-46bc-9247-1cf725d9a03d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:23.629427 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0f943f7a-3b60-46bc-9247-1cf725d9a03d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:23.629898 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0f943f7a-3b60-46bc-9247-1cf725d9a03d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:23.693063 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0f943f7a-3b60-46bc-9247-1cf725d9a03d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:23.701335 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0f943f7a-3b60-46bc-9247-1cf725d9a03d tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1292 microversion: 2.1 time: 0.084818 Apr 12 14:59:23.702292 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 343/681] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:23 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:24.297991 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bc700ad4-5712-44e8-b45e-2e781555beb6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:24.298623 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bc700ad4-5712-44e8-b45e-2e781555beb6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: dfd692aa-e03c-4686-8512-e5b6d426893f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:24.305855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc700ad4-5712-44e8-b45e-2e781555beb6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:24.306295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc700ad4-5712-44e8-b45e-2e781555beb6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:24.307067 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc700ad4-5712-44e8-b45e-2e781555beb6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:24.307494 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc700ad4-5712-44e8-b45e-2e781555beb6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:24.325001 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-bc700ad4-5712-44e8-b45e-2e781555beb6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] HTTP exception thrown: Instance dfd692aa-e03c-4686-8512-e5b6d426893f could not be found. Apr 12 14:59:24.325585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bc700ad4-5712-44e8-b45e-2e781555beb6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Returning 404 to user: Instance dfd692aa-e03c-4686-8512-e5b6d426893f could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:24.326645 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bc700ad4-5712-44e8-b45e-2e781555beb6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f" status: 404 len: 111 microversion: 2.1 time: 0.036104 Apr 12 14:59:24.327199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 339/682] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:24 2022] GET /compute/v2.1/servers/dfd692aa-e03c-4686-8512-e5b6d426893f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:59:24.336018 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-96b2630d-6690-4497-b95f-ef09461ef07f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '.version_select at 0x7fbd6083cc10>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:24.427849 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-96b2630d-6690-4497-b95f-ef09461ef07f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-32305355" status: 202 len: 0 microversion: 2.1 time: 0.094633 Apr 12 14:59:24.428432 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 344/683] 10.222.0.64 () {58 vars in 1214 bytes} [Tue Apr 12 14:59:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-32305355 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:59:24.719631 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4828ecd0-d15f-4009-8dd7-070eaeb1d7cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:24.720598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4828ecd0-d15f-4009-8dd7-070eaeb1d7cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:24.729196 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4828ecd0-d15f-4009-8dd7-070eaeb1d7cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:24.729672 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4828ecd0-d15f-4009-8dd7-070eaeb1d7cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:24.730453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4828ecd0-d15f-4009-8dd7-070eaeb1d7cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:24.730892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4828ecd0-d15f-4009-8dd7-070eaeb1d7cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:24.799072 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4828ecd0-d15f-4009-8dd7-070eaeb1d7cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:24.806678 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4828ecd0-d15f-4009-8dd7-070eaeb1d7cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1298 microversion: 2.1 time: 0.091274 Apr 12 14:59:24.807266 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 340/684] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:24 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:25.800539 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-1c631d0c-0183-425c-a5f3-c6cba7fe172e req-3f1a6aea-920d-4286-a5a2-70738fe7d891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54aad714-d9bc-4325-92c4-d0bd27ee9f8e", "tag": "38807db4-8d4f-4f2b-a507-82221710ecd9"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:25.811369 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-1c631d0c-0183-425c-a5f3-c6cba7fe172e req-3f1a6aea-920d-4286-a5a2-70738fe7d891 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:25.811915 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-1c631d0c-0183-425c-a5f3-c6cba7fe172e req-3f1a6aea-920d-4286-a5a2-70738fe7d891 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:25.823445 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-1c631d0c-0183-425c-a5f3-c6cba7fe172e req-3f1a6aea-920d-4286-a5a2-70738fe7d891 service nova] Creating event network-changed:38807db4-8d4f-4f2b-a507-82221710ecd9 for instance 54aad714-d9bc-4325-92c4-d0bd27ee9f8e on hv-cinder-83752 Apr 12 14:59:25.824675 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b621e624-cd14-4d1a-b7df-15358ce18b71 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:25.825281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b621e624-cd14-4d1a-b7df-15358ce18b71 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:25.831840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-1c631d0c-0183-425c-a5f3-c6cba7fe172e req-3f1a6aea-920d-4286-a5a2-70738fe7d891 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037032 Apr 12 14:59:25.832292 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b621e624-cd14-4d1a-b7df-15358ce18b71 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:25.832890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 345/685] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:25.834371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b621e624-cd14-4d1a-b7df-15358ce18b71 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:25.836209 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b621e624-cd14-4d1a-b7df-15358ce18b71 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:25.836939 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b621e624-cd14-4d1a-b7df-15358ce18b71 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:25.986969 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b621e624-cd14-4d1a-b7df-15358ce18b71 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:25.996536 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b621e624-cd14-4d1a-b7df-15358ce18b71 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1365 microversion: 2.1 time: 0.176017 Apr 12 14:59:25.997154 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 341/686] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:25 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:59:27.015084 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-904e7292-882a-434f-9ac0-2b350a327880 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:27.015697 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-904e7292-882a-434f-9ac0-2b350a327880 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:27.022799 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-904e7292-882a-434f-9ac0-2b350a327880 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:27.023248 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-904e7292-882a-434f-9ac0-2b350a327880 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:27.024017 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-904e7292-882a-434f-9ac0-2b350a327880 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:27.024482 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-904e7292-882a-434f-9ac0-2b350a327880 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:27.151937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-904e7292-882a-434f-9ac0-2b350a327880 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:27.159079 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-904e7292-882a-434f-9ac0-2b350a327880 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1365 microversion: 2.1 time: 0.148749 Apr 12 14:59:27.159668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 346/687] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:27 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:27.704893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9c6a545f-1d55-4317-81ef-d42d03eb4e6a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:27.705390 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9c6a545f-1d55-4317-81ef-d42d03eb4e6a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:27.711656 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c6a545f-1d55-4317-81ef-d42d03eb4e6a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:27.712100 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c6a545f-1d55-4317-81ef-d42d03eb4e6a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:27.712864 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c6a545f-1d55-4317-81ef-d42d03eb4e6a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:27.713300 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c6a545f-1d55-4317-81ef-d42d03eb4e6a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:27.736437 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9c6a545f-1d55-4317-81ef-d42d03eb4e6a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 14:59:28.038202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9c6a545f-1d55-4317-81ef-d42d03eb4e6a tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "DELETE /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 204 len: 0 microversion: 2.1 time: 0.336766 Apr 12 14:59:28.038795 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 342/688] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 14:59:27 2022] DELETE /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 14:59:28.046812 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3a115503-c863-431a-a0ef-6b8f7933f822 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:28.047417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3a115503-c863-431a-a0ef-6b8f7933f822 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:28.054911 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a115503-c863-431a-a0ef-6b8f7933f822 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:28.055351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a115503-c863-431a-a0ef-6b8f7933f822 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:28.056105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a115503-c863-431a-a0ef-6b8f7933f822 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:28.056529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a115503-c863-431a-a0ef-6b8f7933f822 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:28.177599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dbc5ea80-8d18-42aa-8640-1e6037c1a114 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:28.178366 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dbc5ea80-8d18-42aa-8640-1e6037c1a114 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:28.184268 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbc5ea80-8d18-42aa-8640-1e6037c1a114 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:28.184719 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbc5ea80-8d18-42aa-8640-1e6037c1a114 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:28.185497 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbc5ea80-8d18-42aa-8640-1e6037c1a114 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:28.185967 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dbc5ea80-8d18-42aa-8640-1e6037c1a114 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:28.190156 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3a115503-c863-431a-a0ef-6b8f7933f822 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:28.197941 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3a115503-c863-431a-a0ef-6b8f7933f822 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1509 microversion: 2.1 time: 0.154840 Apr 12 14:59:28.198513 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 347/689] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:28 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:28.311638 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dbc5ea80-8d18-42aa-8640-1e6037c1a114 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:28.318917 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dbc5ea80-8d18-42aa-8640-1e6037c1a114 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1365 microversion: 2.1 time: 0.146271 Apr 12 14:59:28.319475 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 343/690] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:28 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:59:29.215396 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c6d32ee7-e620-448e-b046-7b974b0df2e1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:29.216003 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c6d32ee7-e620-448e-b046-7b974b0df2e1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:29.222502 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6d32ee7-e620-448e-b046-7b974b0df2e1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:29.222956 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6d32ee7-e620-448e-b046-7b974b0df2e1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:29.223734 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6d32ee7-e620-448e-b046-7b974b0df2e1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:29.224226 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6d32ee7-e620-448e-b046-7b974b0df2e1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:29.336281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d7f3a9f8-48fa-4d5f-ba47-793206b4ee07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:29.337417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d7f3a9f8-48fa-4d5f-ba47-793206b4ee07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:29.344649 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7f3a9f8-48fa-4d5f-ba47-793206b4ee07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:29.345100 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7f3a9f8-48fa-4d5f-ba47-793206b4ee07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:29.346105 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7f3a9f8-48fa-4d5f-ba47-793206b4ee07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:29.346545 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7f3a9f8-48fa-4d5f-ba47-793206b4ee07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:29.352861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c6d32ee7-e620-448e-b046-7b974b0df2e1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:29.360330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c6d32ee7-e620-448e-b046-7b974b0df2e1 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1509 microversion: 2.1 time: 0.148830 Apr 12 14:59:29.360912 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 348/691] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:29 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:29.476455 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d7f3a9f8-48fa-4d5f-ba47-793206b4ee07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:29.483660 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d7f3a9f8-48fa-4d5f-ba47-793206b4ee07 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1365 microversion: 2.1 time: 0.151382 Apr 12 14:59:29.484220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 344/692] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:29 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:59:30.378015 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e99f7866-d487-433c-9a83-d3c5c54f4e4b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:30.378560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e99f7866-d487-433c-9a83-d3c5c54f4e4b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:30.385390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e99f7866-d487-433c-9a83-d3c5c54f4e4b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:30.385905 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e99f7866-d487-433c-9a83-d3c5c54f4e4b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:30.386686 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e99f7866-d487-433c-9a83-d3c5c54f4e4b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:30.387139 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e99f7866-d487-433c-9a83-d3c5c54f4e4b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:30.501155 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4a8825f0-6c83-4a7d-aeca-28c771d5e061 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:30.501779 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4a8825f0-6c83-4a7d-aeca-28c771d5e061 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:30.509286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a8825f0-6c83-4a7d-aeca-28c771d5e061 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:30.509816 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a8825f0-6c83-4a7d-aeca-28c771d5e061 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:30.510583 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a8825f0-6c83-4a7d-aeca-28c771d5e061 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:30.511010 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a8825f0-6c83-4a7d-aeca-28c771d5e061 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:30.514402 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e99f7866-d487-433c-9a83-d3c5c54f4e4b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:30.523536 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e99f7866-d487-433c-9a83-d3c5c54f4e4b tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1509 microversion: 2.1 time: 0.149438 Apr 12 14:59:30.524111 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 349/693] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:30 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:30.642299 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4a8825f0-6c83-4a7d-aeca-28c771d5e061 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:30.650344 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4a8825f0-6c83-4a7d-aeca-28c771d5e061 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1365 microversion: 2.1 time: 0.152966 Apr 12 14:59:30.650913 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 345/694] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:30 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:59:31.130256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-5162619c-0e98-4ced-ad45-8866fdfa6807 req-ec222855-35f7-46ec-b09f-f792002654fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71207994-1780-4e45-b693-8455d8038f21", "name": "network-vif-deleted", "tag": "5d8aa5a2-fd7c-4d6a-b44f-15e67a9087c0"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:31.138280 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-5162619c-0e98-4ced-ad45-8866fdfa6807 req-ec222855-35f7-46ec-b09f-f792002654fd service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:31.138718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-5162619c-0e98-4ced-ad45-8866fdfa6807 req-ec222855-35f7-46ec-b09f-f792002654fd service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:31.150707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-5162619c-0e98-4ced-ad45-8866fdfa6807 req-ec222855-35f7-46ec-b09f-f792002654fd service nova] Creating event network-vif-deleted:5d8aa5a2-fd7c-4d6a-b44f-15e67a9087c0 for instance 71207994-1780-4e45-b693-8455d8038f21 on hv-cinder-83752 Apr 12 14:59:31.155737 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-5162619c-0e98-4ced-ad45-8866fdfa6807 req-ec222855-35f7-46ec-b09f-f792002654fd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029323 Apr 12 14:59:31.156325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 350/695] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:31.424746 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-c8839481-2578-4f82-8e78-2b00ac217447 req-311a91ac-dc06-4c8d-9022-32821c24e601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54aad714-d9bc-4325-92c4-d0bd27ee9f8e", "name": "network-vif-plugged", "status": "completed", "tag": "38807db4-8d4f-4f2b-a507-82221710ecd9"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:31.435061 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-c8839481-2578-4f82-8e78-2b00ac217447 req-311a91ac-dc06-4c8d-9022-32821c24e601 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:31.435734 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-c8839481-2578-4f82-8e78-2b00ac217447 req-311a91ac-dc06-4c8d-9022-32821c24e601 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:31.452594 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-c8839481-2578-4f82-8e78-2b00ac217447 req-311a91ac-dc06-4c8d-9022-32821c24e601 service nova] Creating event network-vif-plugged:38807db4-8d4f-4f2b-a507-82221710ecd9 for instance 54aad714-d9bc-4325-92c4-d0bd27ee9f8e on hv-cinder-83752 Apr 12 14:59:31.459314 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-c8839481-2578-4f82-8e78-2b00ac217447 req-311a91ac-dc06-4c8d-9022-32821c24e601 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039536 Apr 12 14:59:31.460669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 346/696] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:31.543235 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:31.544581 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:31.554016 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:31.554781 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:31.555989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:31.556588 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:31.590603 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:31.591051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:31.591493 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lazy-loading 'fault' on Instance uuid 71207994-1780-4e45-b693-8455d8038f21 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:59:31.632367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:31.639495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d4ebbf15-d241-4547-a19a-8aedf09eb364 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 200 len: 1312 microversion: 2.1 time: 0.102490 Apr 12 14:59:31.640004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 351/697] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:31 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:31.667750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c438bbbe-0796-40c5-9cda-456bbaf587e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:31.668724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c438bbbe-0796-40c5-9cda-456bbaf587e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:31.674984 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c438bbbe-0796-40c5-9cda-456bbaf587e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:31.675431 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c438bbbe-0796-40c5-9cda-456bbaf587e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:31.676893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c438bbbe-0796-40c5-9cda-456bbaf587e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:31.677435 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c438bbbe-0796-40c5-9cda-456bbaf587e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:31.807499 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c438bbbe-0796-40c5-9cda-456bbaf587e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:31.814915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c438bbbe-0796-40c5-9cda-456bbaf587e1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1365 microversion: 2.1 time: 0.151505 Apr 12 14:59:31.815476 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 347/698] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:31 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:31.968991 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-cf0feeb6-068d-495e-bcd7-51a55bc3b52f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:31.969892 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cf0feeb6-068d-495e-bcd7-51a55bc3b52f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:31.980927 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cf0feeb6-068d-495e-bcd7-51a55bc3b52f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:31.981726 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cf0feeb6-068d-495e-bcd7-51a55bc3b52f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:31.982642 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cf0feeb6-068d-495e-bcd7-51a55bc3b52f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:31.983285 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cf0feeb6-068d-495e-bcd7-51a55bc3b52f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:32.014808 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-cf0feeb6-068d-495e-bcd7-51a55bc3b52f tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/ips" status: 200 len: 145 microversion: 2.1 time: 0.104254 Apr 12 14:59:32.015417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 352/699] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Apr 12 14:59:31 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/ips => generated 145 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:32.717215 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-492ef0bb-fcf0-46a1-b36d-7dcadf0e124f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:32.719200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-492ef0bb-fcf0-46a1-b36d-7dcadf0e124f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 71207994-1780-4e45-b693-8455d8038f21] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:32.725233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-492ef0bb-fcf0-46a1-b36d-7dcadf0e124f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:32.727215 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-492ef0bb-fcf0-46a1-b36d-7dcadf0e124f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:32.727215 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-492ef0bb-fcf0-46a1-b36d-7dcadf0e124f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:32.727868 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-492ef0bb-fcf0-46a1-b36d-7dcadf0e124f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:32.742978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-492ef0bb-fcf0-46a1-b36d-7dcadf0e124f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] HTTP exception thrown: Instance 71207994-1780-4e45-b693-8455d8038f21 could not be found. Apr 12 14:59:32.743552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-492ef0bb-fcf0-46a1-b36d-7dcadf0e124f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Returning 404 to user: Instance 71207994-1780-4e45-b693-8455d8038f21 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:32.744363 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-492ef0bb-fcf0-46a1-b36d-7dcadf0e124f tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21" status: 404 len: 111 microversion: 2.1 time: 0.091738 Apr 12 14:59:32.745000 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 348/700] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:32 2022] GET /compute/v2.1/servers/71207994-1780-4e45-b693-8455d8038f21 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:59:32.753304 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-30df0c1d-399f-4ddb-9b40-7dacaaf21c0c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:32.753910 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-30df0c1d-399f-4ddb-9b40-7dacaaf21c0c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:32.760259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-30df0c1d-399f-4ddb-9b40-7dacaaf21c0c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:32.760707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-30df0c1d-399f-4ddb-9b40-7dacaaf21c0c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:32.761529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-30df0c1d-399f-4ddb-9b40-7dacaaf21c0c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:32.762000 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-30df0c1d-399f-4ddb-9b40-7dacaaf21c0c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:32.786640 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-30df0c1d-399f-4ddb-9b40-7dacaaf21c0c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 14:59:32.833162 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b3e19ce7-afb3-4330-a130-f2dc9f53213f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:32.833811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b3e19ce7-afb3-4330-a130-f2dc9f53213f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:32.841269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3e19ce7-afb3-4330-a130-f2dc9f53213f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:32.841746 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3e19ce7-afb3-4330-a130-f2dc9f53213f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:32.842522 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3e19ce7-afb3-4330-a130-f2dc9f53213f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:32.842948 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b3e19ce7-afb3-4330-a130-f2dc9f53213f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:32.974014 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b3e19ce7-afb3-4330-a130-f2dc9f53213f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:32.981572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b3e19ce7-afb3-4330-a130-f2dc9f53213f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1365 microversion: 2.1 time: 0.152509 Apr 12 14:59:32.982199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 349/701] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:32 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:59:33.071234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-30df0c1d-399f-4ddb-9b40-7dacaaf21c0c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "DELETE /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 204 len: 0 microversion: 2.1 time: 0.321537 Apr 12 14:59:33.071817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 353/702] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 14:59:32 2022] DELETE /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 14:59:33.079933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6cabc047-b60a-4f39-ace5-eef9f58105b6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:33.080540 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6cabc047-b60a-4f39-ace5-eef9f58105b6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:33.087158 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6cabc047-b60a-4f39-ace5-eef9f58105b6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:33.087605 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6cabc047-b60a-4f39-ace5-eef9f58105b6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:33.088380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6cabc047-b60a-4f39-ace5-eef9f58105b6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:33.088815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6cabc047-b60a-4f39-ace5-eef9f58105b6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:33.231343 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6cabc047-b60a-4f39-ace5-eef9f58105b6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:33.238641 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6cabc047-b60a-4f39-ace5-eef9f58105b6 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.162505 Apr 12 14:59:33.241062 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 350/703] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:33 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:33.693397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-31a8815e-3585-4632-9f32-aaca92bb2388 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d46473bf-9509-4ac6-93f2-13506cc03614"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:33.694611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-31a8815e-3585-4632-9f32-aaca92bb2388 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:33.700710 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-31a8815e-3585-4632-9f32-aaca92bb2388 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:33.701162 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-31a8815e-3585-4632-9f32-aaca92bb2388 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:33.702234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-31a8815e-3585-4632-9f32-aaca92bb2388 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:33.702709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-31a8815e-3585-4632-9f32-aaca92bb2388 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:34.000367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6201c351-1985-4bbb-aa7f-0fc7fd4befb2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:34.000919 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6201c351-1985-4bbb-aa7f-0fc7fd4befb2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:34.009044 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6201c351-1985-4bbb-aa7f-0fc7fd4befb2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:34.009654 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6201c351-1985-4bbb-aa7f-0fc7fd4befb2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:34.010512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6201c351-1985-4bbb-aa7f-0fc7fd4befb2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:34.011108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6201c351-1985-4bbb-aa7f-0fc7fd4befb2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:34.149153 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6201c351-1985-4bbb-aa7f-0fc7fd4befb2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:34.156678 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6201c351-1985-4bbb-aa7f-0fc7fd4befb2 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1554 microversion: 2.1 time: 0.161263 Apr 12 14:59:34.157239 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 351/704] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:33 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:59:34.173469 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c9be1e30-cd9f-4108-9f60-8e681df6807e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:34.173972 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c9be1e30-cd9f-4108-9f60-8e681df6807e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:34.180811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9be1e30-cd9f-4108-9f60-8e681df6807e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:34.181246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9be1e30-cd9f-4108-9f60-8e681df6807e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:34.182031 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9be1e30-cd9f-4108-9f60-8e681df6807e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:34.182456 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c9be1e30-cd9f-4108-9f60-8e681df6807e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:34.258633 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c9be1e30-cd9f-4108-9f60-8e681df6807e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088697 Apr 12 14:59:34.259218 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 352/705] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Apr 12 14:59:34 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:59:34.263767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3c76d71f-2244-4b26-8243-34bcd9786117 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:34.264362 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3c76d71f-2244-4b26-8243-34bcd9786117 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:34.271013 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c76d71f-2244-4b26-8243-34bcd9786117 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:34.271459 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c76d71f-2244-4b26-8243-34bcd9786117 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:34.272226 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c76d71f-2244-4b26-8243-34bcd9786117 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:34.272850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3c76d71f-2244-4b26-8243-34bcd9786117 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:34.538613 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3c76d71f-2244-4b26-8243-34bcd9786117 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:34.546346 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3c76d71f-2244-4b26-8243-34bcd9786117 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.286136 Apr 12 14:59:34.547016 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 353/706] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:34 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:34.603298 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9f0a5b36-792f-40cb-afa8-09351d23de22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:34.603796 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9f0a5b36-792f-40cb-afa8-09351d23de22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:34.609856 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0a5b36-792f-40cb-afa8-09351d23de22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:34.610306 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0a5b36-792f-40cb-afa8-09351d23de22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:34.611072 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0a5b36-792f-40cb-afa8-09351d23de22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:34.611552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0a5b36-792f-40cb-afa8-09351d23de22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:34.634027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9f0a5b36-792f-40cb-afa8-09351d23de22 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/ips" status: 200 len: 152 microversion: 2.20 time: 0.085970 Apr 12 14:59:34.634600 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 354/707] 10.222.0.64 () {60 vars in 1288 bytes} [Tue Apr 12 14:59:34 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/ips => generated 152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 14:59:35.563923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-358a4c02-4541-4323-a161-343bff06d18c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:35.564722 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-358a4c02-4541-4323-a161-343bff06d18c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:35.571559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-358a4c02-4541-4323-a161-343bff06d18c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:35.572273 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-358a4c02-4541-4323-a161-343bff06d18c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:35.573039 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-358a4c02-4541-4323-a161-343bff06d18c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:35.573468 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-358a4c02-4541-4323-a161-343bff06d18c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:35.719459 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-358a4c02-4541-4323-a161-343bff06d18c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:35.726943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-358a4c02-4541-4323-a161-343bff06d18c tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.166777 Apr 12 14:59:35.727517 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 355/708] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:35 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 14:59:35.732145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-4a724823-323e-41a9-ba88-250be4a23bfb req-dd4d7739-80e7-4e52-b195-bca5b2535cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54aad714-d9bc-4325-92c4-d0bd27ee9f8e", "tag": "38807db4-8d4f-4f2b-a507-82221710ecd9"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:35.740132 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-4a724823-323e-41a9-ba88-250be4a23bfb req-dd4d7739-80e7-4e52-b195-bca5b2535cc2 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:35.743036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-4a724823-323e-41a9-ba88-250be4a23bfb req-dd4d7739-80e7-4e52-b195-bca5b2535cc2 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:35.751117 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-4a724823-323e-41a9-ba88-250be4a23bfb req-dd4d7739-80e7-4e52-b195-bca5b2535cc2 service nova] Creating event network-changed:38807db4-8d4f-4f2b-a507-82221710ecd9 for instance 54aad714-d9bc-4325-92c4-d0bd27ee9f8e on hv-cinder-83752 Apr 12 14:59:35.756901 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-4a724823-323e-41a9-ba88-250be4a23bfb req-dd4d7739-80e7-4e52-b195-bca5b2535cc2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028189 Apr 12 14:59:35.757518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 356/709] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:36.745325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-47a7f352-9eb7-4a7e-8925-fe778e172715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:36.746045 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-47a7f352-9eb7-4a7e-8925-fe778e172715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:36.752806 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-47a7f352-9eb7-4a7e-8925-fe778e172715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:36.753247 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-47a7f352-9eb7-4a7e-8925-fe778e172715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:36.754065 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-47a7f352-9eb7-4a7e-8925-fe778e172715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:36.755254 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-47a7f352-9eb7-4a7e-8925-fe778e172715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:36.908746 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-47a7f352-9eb7-4a7e-8925-fe778e172715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:36.916875 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-47a7f352-9eb7-4a7e-8925-fe778e172715 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1521 microversion: 2.1 time: 0.176062 Apr 12 14:59:36.917473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 357/710] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:36 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:36.926771 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-538a5e49-3a39-46ab-bccd-764fa7510919 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:36.926771 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-538a5e49-3a39-46ab-bccd-764fa7510919 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:36.931456 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-538a5e49-3a39-46ab-bccd-764fa7510919 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:36.936353 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-538a5e49-3a39-46ab-bccd-764fa7510919 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:36.936353 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-538a5e49-3a39-46ab-bccd-764fa7510919 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:36.936353 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-538a5e49-3a39-46ab-bccd-764fa7510919 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:36.956514 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-538a5e49-3a39-46ab-bccd-764fa7510919 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lazy-loading 'flavor' on Instance uuid 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:59:37.394168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-31a8815e-3585-4632-9f32-aaca92bb2388 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.705563 Apr 12 14:59:37.398853 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 354/711] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 14:59:33 2022] POST /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments => generated 194 bytes in 3708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:37.561511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-538a5e49-3a39-46ab-bccd-764fa7510919 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "POST /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/action" status: 202 len: 0 microversion: 2.20 time: 0.642537 Apr 12 14:59:37.562356 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 358/712] 10.222.0.64 () {62 vars in 1318 bytes} [Tue Apr 12 14:59:36 2022] POST /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 14:59:37.574454 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bfe6bf42-584c-47ba-82b5-105204072a43 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:37.576005 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bfe6bf42-584c-47ba-82b5-105204072a43 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:37.584351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bfe6bf42-584c-47ba-82b5-105204072a43 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:37.584981 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bfe6bf42-584c-47ba-82b5-105204072a43 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:37.585977 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bfe6bf42-584c-47ba-82b5-105204072a43 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:37.586707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bfe6bf42-584c-47ba-82b5-105204072a43 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:37.730882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bfe6bf42-584c-47ba-82b5-105204072a43 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:37.734288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bfe6bf42-584c-47ba-82b5-105204072a43 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:37.735779 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bfe6bf42-584c-47ba-82b5-105204072a43 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:37.736926 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bfe6bf42-584c-47ba-82b5-105204072a43 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.170287 Apr 12 14:59:37.737479 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 355/713] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:37 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:37.867114 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-be2348e8-2ca6-487d-a926-256238072d65 req-d7a17d7b-c4f0-4165-a2f2-ed6068627213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e6b586-ce02-4394-a2a1-6ae5e0f09306", "name": "network-vif-deleted", "tag": "f7b6eb0e-0b23-4a4b-81d8-d386bce95c9e"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:37.875182 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-be2348e8-2ca6-487d-a926-256238072d65 req-d7a17d7b-c4f0-4165-a2f2-ed6068627213 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:37.878148 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-be2348e8-2ca6-487d-a926-256238072d65 req-d7a17d7b-c4f0-4165-a2f2-ed6068627213 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:37.886800 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-be2348e8-2ca6-487d-a926-256238072d65 req-d7a17d7b-c4f0-4165-a2f2-ed6068627213 service nova] Creating event network-vif-deleted:f7b6eb0e-0b23-4a4b-81d8-d386bce95c9e for instance 92e6b586-ce02-4394-a2a1-6ae5e0f09306 on hv-cinder-83752 Apr 12 14:59:37.891910 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-be2348e8-2ca6-487d-a926-256238072d65 req-d7a17d7b-c4f0-4165-a2f2-ed6068627213 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029287 Apr 12 14:59:37.892495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 359/714] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:37.933792 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ca485203-979f-4b31-b6bd-1f9ba6dbe204 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:37.934397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ca485203-979f-4b31-b6bd-1f9ba6dbe204 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:37.940636 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca485203-979f-4b31-b6bd-1f9ba6dbe204 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:37.941085 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca485203-979f-4b31-b6bd-1f9ba6dbe204 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:37.942534 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca485203-979f-4b31-b6bd-1f9ba6dbe204 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:37.942963 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ca485203-979f-4b31-b6bd-1f9ba6dbe204 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:38.001975 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ca485203-979f-4b31-b6bd-1f9ba6dbe204 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb985e9c053f4c379f14c7ac21fb89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566788e9e53f44db92dfad7ee91d6cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:38.010094 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ca485203-979f-4b31-b6bd-1f9ba6dbe204 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 200 len: 1479 microversion: 2.1 time: 0.080111 Apr 12 14:59:38.010675 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 356/715] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:37 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 1479 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 14:59:38.755136 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-57ff6188-118a-4bb2-92a5-37728ad3f437 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:38.755856 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-57ff6188-118a-4bb2-92a5-37728ad3f437 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:38.762193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57ff6188-118a-4bb2-92a5-37728ad3f437 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:38.762637 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57ff6188-118a-4bb2-92a5-37728ad3f437 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:38.763401 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57ff6188-118a-4bb2-92a5-37728ad3f437 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:38.763855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57ff6188-118a-4bb2-92a5-37728ad3f437 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:38.901914 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-57ff6188-118a-4bb2-92a5-37728ad3f437 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:38.909611 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-57ff6188-118a-4bb2-92a5-37728ad3f437 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:38.912380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-57ff6188-118a-4bb2-92a5-37728ad3f437 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:38.913523 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-57ff6188-118a-4bb2-92a5-37728ad3f437 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.162804 Apr 12 14:59:38.914096 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 360/716] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:38 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:39.027749 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3ff6abe3-736c-4fdb-a484-85707f291e64 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:39.028353 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3ff6abe3-736c-4fdb-a484-85707f291e64 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] [instance: 92e6b586-ce02-4394-a2a1-6ae5e0f09306] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:39.034604 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3ff6abe3-736c-4fdb-a484-85707f291e64 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:39.035705 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3ff6abe3-736c-4fdb-a484-85707f291e64 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:39.036478 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3ff6abe3-736c-4fdb-a484-85707f291e64 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:39.036923 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3ff6abe3-736c-4fdb-a484-85707f291e64 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:39.050343 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-3ff6abe3-736c-4fdb-a484-85707f291e64 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] HTTP exception thrown: Instance 92e6b586-ce02-4394-a2a1-6ae5e0f09306 could not be found. Apr 12 14:59:39.051387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3ff6abe3-736c-4fdb-a484-85707f291e64 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] Returning 404 to user: Instance 92e6b586-ce02-4394-a2a1-6ae5e0f09306 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:39.051790 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3ff6abe3-736c-4fdb-a484-85707f291e64 tempest-ServerRescueNegativeTestJSON-1553548520 tempest-ServerRescueNegativeTestJSON-1553548520-project] 10.222.0.64 "GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306" status: 404 len: 111 microversion: 2.1 time: 0.028048 Apr 12 14:59:39.052331 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 357/717] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 14:59:39 2022] GET /compute/v2.1/servers/92e6b586-ce02-4394-a2a1-6ae5e0f09306 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:59:39.932528 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6d67b6e0-e276-4184-8ad3-9947cb6995ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:39.933128 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6d67b6e0-e276-4184-8ad3-9947cb6995ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:39.939862 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d67b6e0-e276-4184-8ad3-9947cb6995ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:39.940309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d67b6e0-e276-4184-8ad3-9947cb6995ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:39.941090 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d67b6e0-e276-4184-8ad3-9947cb6995ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:39.942186 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d67b6e0-e276-4184-8ad3-9947cb6995ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:40.196967 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6d67b6e0-e276-4184-8ad3-9947cb6995ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:40.204764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6d67b6e0-e276-4184-8ad3-9947cb6995ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:40.206447 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6d67b6e0-e276-4184-8ad3-9947cb6995ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:40.207753 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6d67b6e0-e276-4184-8ad3-9947cb6995ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.279203 Apr 12 14:59:40.208308 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 361/718] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:39 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:41.226644 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-df203c38-4524-4e74-9497-663da4db47a4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:41.227187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-df203c38-4524-4e74-9497-663da4db47a4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:41.233415 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df203c38-4524-4e74-9497-663da4db47a4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:41.234167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df203c38-4524-4e74-9497-663da4db47a4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:41.234952 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df203c38-4524-4e74-9497-663da4db47a4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:41.235382 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df203c38-4524-4e74-9497-663da4db47a4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:41.445611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-df203c38-4524-4e74-9497-663da4db47a4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:41.453777 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-df203c38-4524-4e74-9497-663da4db47a4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:41.455531 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-df203c38-4524-4e74-9497-663da4db47a4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:41.457414 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-df203c38-4524-4e74-9497-663da4db47a4 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.234944 Apr 12 14:59:41.458057 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 358/719] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:41 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:42.476665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d7b03a6d-0fa1-475c-b2ea-463c195f1c7d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:42.478037 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d7b03a6d-0fa1-475c-b2ea-463c195f1c7d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:42.486749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7b03a6d-0fa1-475c-b2ea-463c195f1c7d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:42.487274 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7b03a6d-0fa1-475c-b2ea-463c195f1c7d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:42.488717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7b03a6d-0fa1-475c-b2ea-463c195f1c7d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:42.489365 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d7b03a6d-0fa1-475c-b2ea-463c195f1c7d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:42.744769 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d7b03a6d-0fa1-475c-b2ea-463c195f1c7d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:42.753086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d7b03a6d-0fa1-475c-b2ea-463c195f1c7d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:42.755743 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d7b03a6d-0fa1-475c-b2ea-463c195f1c7d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:42.756996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d7b03a6d-0fa1-475c-b2ea-463c195f1c7d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.285004 Apr 12 14:59:42.757665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 362/720] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:42 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:43.776834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2c5b9640-32e9-4cb9-93e2-46aa555a9d7c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:43.778323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2c5b9640-32e9-4cb9-93e2-46aa555a9d7c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:43.790782 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c5b9640-32e9-4cb9-93e2-46aa555a9d7c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:43.791228 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c5b9640-32e9-4cb9-93e2-46aa555a9d7c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:43.797206 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c5b9640-32e9-4cb9-93e2-46aa555a9d7c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:43.797729 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c5b9640-32e9-4cb9-93e2-46aa555a9d7c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:43.945311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2c5b9640-32e9-4cb9-93e2-46aa555a9d7c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:43.953606 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2c5b9640-32e9-4cb9-93e2-46aa555a9d7c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:43.955122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2c5b9640-32e9-4cb9-93e2-46aa555a9d7c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:43.956484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2c5b9640-32e9-4cb9-93e2-46aa555a9d7c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.184181 Apr 12 14:59:43.957647 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 359/721] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:43 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:44.909327 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-754cbe07-ed35-473d-8c89-bdd614516c55 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:44.911011 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-754cbe07-ed35-473d-8c89-bdd614516c55 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:44.917988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-754cbe07-ed35-473d-8c89-bdd614516c55 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:44.918508 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-754cbe07-ed35-473d-8c89-bdd614516c55 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:44.919423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-754cbe07-ed35-473d-8c89-bdd614516c55 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:44.919912 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-754cbe07-ed35-473d-8c89-bdd614516c55 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:44.950368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-754cbe07-ed35-473d-8c89-bdd614516c55 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Apr 12 14:59:44.951272 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 363/722] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:59:44 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:44.961022 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7ce5a24e-f4f3-4085-82e0-6450edc9b7a3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:44.963541 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7ce5a24e-f4f3-4085-82e0-6450edc9b7a3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:44.968518 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ce5a24e-f4f3-4085-82e0-6450edc9b7a3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:44.968966 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ce5a24e-f4f3-4085-82e0-6450edc9b7a3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:44.970378 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ce5a24e-f4f3-4085-82e0-6450edc9b7a3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:44.970801 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ce5a24e-f4f3-4085-82e0-6450edc9b7a3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:44.975918 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0c511915-8f2a-4887-b056-6856b090a42e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:44.976548 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0c511915-8f2a-4887-b056-6856b090a42e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:44.983957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c511915-8f2a-4887-b056-6856b090a42e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:44.984396 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c511915-8f2a-4887-b056-6856b090a42e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:44.985160 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c511915-8f2a-4887-b056-6856b090a42e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:44.985736 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0c511915-8f2a-4887-b056-6856b090a42e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:45.000339 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7ce5a24e-f4f3-4085-82e0-6450edc9b7a3 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments/d46473bf-9509-4ac6-93f2-13506cc03614" status: 200 len: 194 microversion: 2.1 time: 0.043285 Apr 12 14:59:45.001287 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 360/723] 10.222.0.64 () {58 vars in 1412 bytes} [Tue Apr 12 14:59:44 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments/d46473bf-9509-4ac6-93f2-13506cc03614 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:59:45.123711 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0c511915-8f2a-4887-b056-6856b090a42e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:45.131911 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0c511915-8f2a-4887-b056-6856b090a42e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:45.133451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0c511915-8f2a-4887-b056-6856b090a42e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:45.134697 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0c511915-8f2a-4887-b056-6856b090a42e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.164056 Apr 12 14:59:45.137662 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 364/724] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:44 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:59:45.156391 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9cf6b94a-29af-4fe5-8a5e-c210b5bea593 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Action: 'create', calling method: .version_select at 0x7fbd608505e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-453897298", "metadata": {"Type": "work"}}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:45.157893 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9cf6b94a-29af-4fe5-8a5e-c210b5bea593 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:45.158668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9cf6b94a-29af-4fe5-8a5e-c210b5bea593 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131084 Apr 12 14:59:45.159210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 361/725] 10.222.0.64 () {60 vars in 1155 bytes} [Tue Apr 12 14:59:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 12 14:59:45.168697 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e2beefd3-f986-4bed-8373-d14156da9ed9 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Action: 'create', calling method: .version_select at 0x7fbd608925e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-650500084", "metadata": {"Type": "work"}}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:45.170118 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e2beefd3-f986-4bed-8373-d14156da9ed9 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:45.170905 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e2beefd3-f986-4bed-8373-d14156da9ed9 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006000 Apr 12 14:59:45.171406 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 365/726] 10.222.0.64 () {60 vars in 1155 bytes} [Tue Apr 12 14:59:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 14:59:45.180013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-255ce81d-0785-42e3-a410-e593caaada30 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Action: 'create', calling method: .version_select at 0x7fbd607ebb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-606379097", "metadata": {"Type": "work"}}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:45.181164 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-255ce81d-0785-42e3-a410-e593caaada30 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:45.181973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-255ce81d-0785-42e3-a410-e593caaada30 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005842 Apr 12 14:59:45.182495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 362/727] 10.222.0.64 () {60 vars in 1155 bytes} [Tue Apr 12 14:59:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 12 14:59:45.190803 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d18aa3a1-feaa-4929-b5c5-2a514bf73058 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Calling method '.version_select at 0x7fbd6087c280>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:45.219606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-d18aa3a1-feaa-4929-b5c5-2a514bf73058 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] HTTP exception thrown: Volume tempest-invalid-1944661499 could not be found. Apr 12 14:59:45.220187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d18aa3a1-feaa-4929-b5c5-2a514bf73058 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Returning 404 to user: Volume tempest-invalid-1944661499 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:45.221086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d18aa3a1-feaa-4929-b5c5-2a514bf73058 tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1944661499" status: 404 len: 99 microversion: 2.1 time: 0.034010 Apr 12 14:59:45.221625 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 366/728] 10.222.0.64 () {58 vars in 1217 bytes} [Tue Apr 12 14:59:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1944661499 => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 12 14:59:45.233291 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-38750a9f-801a-4e6a-8c4d-31aff62bfa7c tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004618 Apr 12 14:59:45.233834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 363/729] 10.222.0.64 () {58 vars in 1139 bytes} [Tue Apr 12 14:59:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 14:59:45.251808 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e7c35134-ffb0-46fc-8e01-c83535b1a21b tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003692 Apr 12 14:59:45.251808 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 367/730] 10.222.0.64 () {58 vars in 1136 bytes} [Tue Apr 12 14:59:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 14:59:45.259463 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-199a6801-48f5-44a2-89ec-33e361cfd91d tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Calling method '.version_select at 0x7fbd60833160>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:45.287869 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-199a6801-48f5-44a2-89ec-33e361cfd91d tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] HTTP exception thrown: Volume 01b920e4-a016-4701-8223-badd3faf18a5 could not be found. Apr 12 14:59:45.288480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-199a6801-48f5-44a2-89ec-33e361cfd91d tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Returning 404 to user: Volume 01b920e4-a016-4701-8223-badd3faf18a5 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:45.289338 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-199a6801-48f5-44a2-89ec-33e361cfd91d tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/01b920e4-a016-4701-8223-badd3faf18a5" status: 404 len: 109 microversion: 2.1 time: 0.033654 Apr 12 14:59:45.289903 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 364/731] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Apr 12 14:59:45 2022] DELETE /compute/v2.1/os-volumes/01b920e4-a016-4701-8223-badd3faf18a5 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:59:45.298866 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b1c65a1a-e4c8-4d7b-bd81-b1b52a8eae6e tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Calling method '.version_select at 0x7fbd60912e50>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:45.326507 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-b1c65a1a-e4c8-4d7b-bd81-b1b52a8eae6e tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] HTTP exception thrown: Volume dca1f545-943d-466e-9bdb-e3b71e62f5e9 could not be found. Apr 12 14:59:45.327091 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b1c65a1a-e4c8-4d7b-bd81-b1b52a8eae6e tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] Returning 404 to user: Volume dca1f545-943d-466e-9bdb-e3b71e62f5e9 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 14:59:45.328088 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b1c65a1a-e4c8-4d7b-bd81-b1b52a8eae6e tempest-VolumesNegativeTest-805980876 tempest-VolumesNegativeTest-805980876-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/dca1f545-943d-466e-9bdb-e3b71e62f5e9" status: 404 len: 109 microversion: 2.1 time: 0.032922 Apr 12 14:59:45.328644 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 368/732] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Apr 12 14:59:45 2022] GET /compute/v2.1/os-volumes/dca1f545-943d-466e-9bdb-e3b71e62f5e9 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 14:59:46.154698 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-20ea3bbf-3351-4822-bda1-bd8137d2d621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:46.155329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-20ea3bbf-3351-4822-bda1-bd8137d2d621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:46.161903 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20ea3bbf-3351-4822-bda1-bd8137d2d621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:46.162357 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20ea3bbf-3351-4822-bda1-bd8137d2d621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:46.163134 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20ea3bbf-3351-4822-bda1-bd8137d2d621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:46.163570 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20ea3bbf-3351-4822-bda1-bd8137d2d621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:46.290734 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-20ea3bbf-3351-4822-bda1-bd8137d2d621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:46.298944 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-20ea3bbf-3351-4822-bda1-bd8137d2d621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:46.305429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-20ea3bbf-3351-4822-bda1-bd8137d2d621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:46.305429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-20ea3bbf-3351-4822-bda1-bd8137d2d621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.152043 Apr 12 14:59:46.305429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 365/733] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:46 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:46.660218 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5b2f8c1a-5dc3-4d57-bc15-354fff16d394 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5998471d-4331-4abc-b8a9-bd6928eebce5"}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:46.661328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5b2f8c1a-5dc3-4d57-bc15-354fff16d394 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:46.667364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b2f8c1a-5dc3-4d57-bc15-354fff16d394 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:46.673530 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b2f8c1a-5dc3-4d57-bc15-354fff16d394 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:46.673530 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b2f8c1a-5dc3-4d57-bc15-354fff16d394 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:46.673530 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b2f8c1a-5dc3-4d57-bc15-354fff16d394 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:47.320668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dbbc227a-625a-4aba-bd99-569ab23e57d7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:47.321358 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dbbc227a-625a-4aba-bd99-569ab23e57d7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:47.327935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbbc227a-625a-4aba-bd99-569ab23e57d7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:47.328383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbbc227a-625a-4aba-bd99-569ab23e57d7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:47.329152 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbbc227a-625a-4aba-bd99-569ab23e57d7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:47.329583 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbbc227a-625a-4aba-bd99-569ab23e57d7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:47.412367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5b2f8c1a-5dc3-4d57-bc15-354fff16d394 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "POST /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756862 Apr 12 14:59:47.413210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 369/734] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 14:59:46 2022] POST /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments => generated 194 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:47.471755 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dbbc227a-625a-4aba-bd99-569ab23e57d7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:47.480463 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dbbc227a-625a-4aba-bd99-569ab23e57d7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:47.481995 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dbbc227a-625a-4aba-bd99-569ab23e57d7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:47.483151 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dbbc227a-625a-4aba-bd99-569ab23e57d7 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.166687 Apr 12 14:59:47.483709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 366/735] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:47 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:59:48.503030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-709119ea-b5f5-4ca9-9dcd-623fb5867548 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:48.504702 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-709119ea-b5f5-4ca9-9dcd-623fb5867548 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:48.510849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-709119ea-b5f5-4ca9-9dcd-623fb5867548 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:48.511361 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-709119ea-b5f5-4ca9-9dcd-623fb5867548 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:48.512312 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-709119ea-b5f5-4ca9-9dcd-623fb5867548 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:48.512810 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-709119ea-b5f5-4ca9-9dcd-623fb5867548 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:48.648942 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-709119ea-b5f5-4ca9-9dcd-623fb5867548 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:48.657613 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-709119ea-b5f5-4ca9-9dcd-623fb5867548 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:48.659126 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-709119ea-b5f5-4ca9-9dcd-623fb5867548 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:48.662130 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-709119ea-b5f5-4ca9-9dcd-623fb5867548 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1746 microversion: 2.20 time: 0.164425 Apr 12 14:59:48.662756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 370/736] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:48 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:49.682039 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7ac38945-1ad2-4d73-bcc9-7ab95eb3af17 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:49.682780 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7ac38945-1ad2-4d73-bcc9-7ab95eb3af17 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:49.689437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ac38945-1ad2-4d73-bcc9-7ab95eb3af17 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:49.689922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ac38945-1ad2-4d73-bcc9-7ab95eb3af17 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:49.690698 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ac38945-1ad2-4d73-bcc9-7ab95eb3af17 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:49.691150 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ac38945-1ad2-4d73-bcc9-7ab95eb3af17 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:49.827783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7ac38945-1ad2-4d73-bcc9-7ab95eb3af17 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:49.836670 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7ac38945-1ad2-4d73-bcc9-7ab95eb3af17 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:49.838225 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7ac38945-1ad2-4d73-bcc9-7ab95eb3af17 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:49.839372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7ac38945-1ad2-4d73-bcc9-7ab95eb3af17 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1746 microversion: 2.20 time: 0.161841 Apr 12 14:59:49.839930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 367/737] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:49 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:50.859452 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f14a4701-3515-4cee-9723-f8afac4bcd63 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:50.860612 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f14a4701-3515-4cee-9723-f8afac4bcd63 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:50.868267 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f14a4701-3515-4cee-9723-f8afac4bcd63 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:50.868723 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f14a4701-3515-4cee-9723-f8afac4bcd63 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:50.869511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f14a4701-3515-4cee-9723-f8afac4bcd63 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:50.869989 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f14a4701-3515-4cee-9723-f8afac4bcd63 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:51.010372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f14a4701-3515-4cee-9723-f8afac4bcd63 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:51.018335 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f14a4701-3515-4cee-9723-f8afac4bcd63 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:51.024013 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f14a4701-3515-4cee-9723-f8afac4bcd63 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:51.024013 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f14a4701-3515-4cee-9723-f8afac4bcd63 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.166182 Apr 12 14:59:51.024013 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 371/738] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:50 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:51.399862 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-d8a3bb28-893f-4082-bd5d-3b44504dc610 req-70fd04e3-3c71-4932-8f48-466af00539f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946d8ea7-5cb9-4e2f-99b4-27f342c44b63", "name": "network-vif-plugged", "status": "completed", "tag": "5c58da46-e5bb-4b4a-8051-745b00e75ae2"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 14:59:51.410939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-d8a3bb28-893f-4082-bd5d-3b44504dc610 req-70fd04e3-3c71-4932-8f48-466af00539f2 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:51.411909 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-d8a3bb28-893f-4082-bd5d-3b44504dc610 req-70fd04e3-3c71-4932-8f48-466af00539f2 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:51.423939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-d8a3bb28-893f-4082-bd5d-3b44504dc610 req-70fd04e3-3c71-4932-8f48-466af00539f2 service nova] Creating event network-vif-plugged:5c58da46-e5bb-4b4a-8051-745b00e75ae2 for instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 on hv-cinder-83752 Apr 12 14:59:51.433401 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-d8a3bb28-893f-4082-bd5d-3b44504dc610 req-70fd04e3-3c71-4932-8f48-466af00539f2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037866 Apr 12 14:59:51.434561 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 368/739] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 14:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:52.039274 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-25ee211a-a1eb-4aa4-bc82-bc894a8ae30f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:52.039877 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-25ee211a-a1eb-4aa4-bc82-bc894a8ae30f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:52.048235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25ee211a-a1eb-4aa4-bc82-bc894a8ae30f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:52.048681 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25ee211a-a1eb-4aa4-bc82-bc894a8ae30f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:52.049459 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25ee211a-a1eb-4aa4-bc82-bc894a8ae30f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:52.049933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-25ee211a-a1eb-4aa4-bc82-bc894a8ae30f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:52.215273 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-25ee211a-a1eb-4aa4-bc82-bc894a8ae30f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:52.225742 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-25ee211a-a1eb-4aa4-bc82-bc894a8ae30f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:52.227339 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-25ee211a-a1eb-4aa4-bc82-bc894a8ae30f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:52.228579 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-25ee211a-a1eb-4aa4-bc82-bc894a8ae30f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.193294 Apr 12 14:59:52.229195 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 372/740] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:52 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:53.255041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3e7c5b8b-c8f4-4bf9-b709-d7a1de45a2ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:53.256817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3e7c5b8b-c8f4-4bf9-b709-d7a1de45a2ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:53.270471 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e7c5b8b-c8f4-4bf9-b709-d7a1de45a2ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:53.271275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e7c5b8b-c8f4-4bf9-b709-d7a1de45a2ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:53.272265 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e7c5b8b-c8f4-4bf9-b709-d7a1de45a2ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:53.272859 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e7c5b8b-c8f4-4bf9-b709-d7a1de45a2ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:53.461309 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3e7c5b8b-c8f4-4bf9-b709-d7a1de45a2ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:53.474863 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3e7c5b8b-c8f4-4bf9-b709-d7a1de45a2ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:53.478043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3e7c5b8b-c8f4-4bf9-b709-d7a1de45a2ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:53.479682 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3e7c5b8b-c8f4-4bf9-b709-d7a1de45a2ca tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.233030 Apr 12 14:59:53.493464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 369/741] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:53 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:54.500606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c4300bf8-e86c-4873-9aa7-e96337a953aa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:54.501135 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c4300bf8-e86c-4873-9aa7-e96337a953aa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:54.508300 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4300bf8-e86c-4873-9aa7-e96337a953aa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:54.508749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4300bf8-e86c-4873-9aa7-e96337a953aa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:54.509530 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4300bf8-e86c-4873-9aa7-e96337a953aa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:54.509991 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4300bf8-e86c-4873-9aa7-e96337a953aa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:54.880270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c4300bf8-e86c-4873-9aa7-e96337a953aa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:54.890677 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c4300bf8-e86c-4873-9aa7-e96337a953aa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:54.891917 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c4300bf8-e86c-4873-9aa7-e96337a953aa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:54.893080 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c4300bf8-e86c-4873-9aa7-e96337a953aa tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.396548 Apr 12 14:59:54.893654 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 373/742] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:54 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:55.912797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-766f9000-5f69-49ac-91c2-719bbbccc12f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:55.913648 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-766f9000-5f69-49ac-91c2-719bbbccc12f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:55.920496 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-766f9000-5f69-49ac-91c2-719bbbccc12f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:55.920940 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-766f9000-5f69-49ac-91c2-719bbbccc12f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:55.921741 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-766f9000-5f69-49ac-91c2-719bbbccc12f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:55.922339 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-766f9000-5f69-49ac-91c2-719bbbccc12f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:56.088875 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ae2ee4d0-16a5-4127-9eee-f75e96807c03 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:56.090090 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-766f9000-5f69-49ac-91c2-719bbbccc12f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:56.090924 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ae2ee4d0-16a5-4127-9eee-f75e96807c03 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:56.098505 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-766f9000-5f69-49ac-91c2-719bbbccc12f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:56.100572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae2ee4d0-16a5-4127-9eee-f75e96807c03 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:56.101160 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae2ee4d0-16a5-4127-9eee-f75e96807c03 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:56.101805 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-766f9000-5f69-49ac-91c2-719bbbccc12f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:56.102210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae2ee4d0-16a5-4127-9eee-f75e96807c03 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:56.102721 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ae2ee4d0-16a5-4127-9eee-f75e96807c03 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:56.103512 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-766f9000-5f69-49ac-91c2-719bbbccc12f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.194935 Apr 12 14:59:56.104593 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 370/743] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:55 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 14:59:56.140651 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ae2ee4d0-16a5-4127-9eee-f75e96807c03 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056850 Apr 12 14:59:56.141348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 374/744] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 14:59:56 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 14:59:56.294280 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-867c3422-83df-4cdd-8095-c58b4f4e400c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:56.295296 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-867c3422-83df-4cdd-8095-c58b4f4e400c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:56.314121 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-867c3422-83df-4cdd-8095-c58b4f4e400c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:56.314915 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-867c3422-83df-4cdd-8095-c58b4f4e400c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:56.317337 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-867c3422-83df-4cdd-8095-c58b4f4e400c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:56.318098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-867c3422-83df-4cdd-8095-c58b4f4e400c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:56.351915 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-867c3422-83df-4cdd-8095-c58b4f4e400c tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments/d46473bf-9509-4ac6-93f2-13506cc03614" status: 200 len: 194 microversion: 2.1 time: 0.064364 Apr 12 14:59:56.353199 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 371/745] 10.222.0.64 () {58 vars in 1412 bytes} [Tue Apr 12 14:59:56 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments/d46473bf-9509-4ac6-93f2-13506cc03614 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:56.363539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2800ffda-26d1-47ea-b773-76264f684be9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:56.364264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2800ffda-26d1-47ea-b773-76264f684be9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:56.370516 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2800ffda-26d1-47ea-b773-76264f684be9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:56.371210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2800ffda-26d1-47ea-b773-76264f684be9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:56.372180 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2800ffda-26d1-47ea-b773-76264f684be9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:56.372847 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2800ffda-26d1-47ea-b773-76264f684be9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:56.465416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-2800ffda-26d1-47ea-b773-76264f684be9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lazy-loading 'services' on Instance uuid 91be4b61-f6fb-4860-9346-f172a57ce12a {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:59:56.750743 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2800ffda-26d1-47ea-b773-76264f684be9 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "DELETE /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments/d46473bf-9509-4ac6-93f2-13506cc03614" status: 202 len: 0 microversion: 2.1 time: 0.391908 Apr 12 14:59:56.751413 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 375/746] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Apr 12 14:59:56 2022] DELETE /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments/d46473bf-9509-4ac6-93f2-13506cc03614 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:59:57.123853 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-47230ed7-8686-419b-8edf-a1b28e4e0547 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:57.124410 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-47230ed7-8686-419b-8edf-a1b28e4e0547 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:57.136123 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47230ed7-8686-419b-8edf-a1b28e4e0547 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:57.136573 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47230ed7-8686-419b-8edf-a1b28e4e0547 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:57.137341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47230ed7-8686-419b-8edf-a1b28e4e0547 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:57.137817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47230ed7-8686-419b-8edf-a1b28e4e0547 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:57.317040 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-47230ed7-8686-419b-8edf-a1b28e4e0547 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:57.327476 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-47230ed7-8686-419b-8edf-a1b28e4e0547 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:57.329068 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-47230ed7-8686-419b-8edf-a1b28e4e0547 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:57.330374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-47230ed7-8686-419b-8edf-a1b28e4e0547 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.211544 Apr 12 14:59:57.341690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 372/747] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:57 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:59:58.349147 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9e88fdc0-b1fa-416f-83ca-2a9b724e3770 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:58.350046 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9e88fdc0-b1fa-416f-83ca-2a9b724e3770 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:58.356687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e88fdc0-b1fa-416f-83ca-2a9b724e3770 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:58.357125 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e88fdc0-b1fa-416f-83ca-2a9b724e3770 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:58.357907 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e88fdc0-b1fa-416f-83ca-2a9b724e3770 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:58.358332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e88fdc0-b1fa-416f-83ca-2a9b724e3770 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:58.519815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9e88fdc0-b1fa-416f-83ca-2a9b724e3770 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:58.528720 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9e88fdc0-b1fa-416f-83ca-2a9b724e3770 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:58.532437 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9e88fdc0-b1fa-416f-83ca-2a9b724e3770 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:58.534021 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9e88fdc0-b1fa-416f-83ca-2a9b724e3770 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.189409 Apr 12 14:59:58.534988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 376/748] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:58 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 14:59:58.960962 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c8d02b85-5838-41d7-8276-0431feed8800 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:58.961546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c8d02b85-5838-41d7-8276-0431feed8800 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:58.967945 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c8d02b85-5838-41d7-8276-0431feed8800 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:58.968579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c8d02b85-5838-41d7-8276-0431feed8800 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:58.969326 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c8d02b85-5838-41d7-8276-0431feed8800 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:58.969887 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c8d02b85-5838-41d7-8276-0431feed8800 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:59.194237 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c8d02b85-5838-41d7-8276-0431feed8800 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments/5998471d-4331-4abc-b8a9-bd6928eebce5" status: 200 len: 194 microversion: 2.1 time: 0.237107 Apr 12 14:59:59.195281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 373/749] 10.222.0.64 () {58 vars in 1412 bytes} [Tue Apr 12 14:59:58 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments/5998471d-4331-4abc-b8a9-bd6928eebce5 => generated 194 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 14:59:59.205270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-38a49517-99e1-4ec6-91b9-6dd364dc2615 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:59.207027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-38a49517-99e1-4ec6-91b9-6dd364dc2615 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:59.219761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38a49517-99e1-4ec6-91b9-6dd364dc2615 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:59.219761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38a49517-99e1-4ec6-91b9-6dd364dc2615 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:59.219761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38a49517-99e1-4ec6-91b9-6dd364dc2615 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:59.219761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38a49517-99e1-4ec6-91b9-6dd364dc2615 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:59.329089 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-38a49517-99e1-4ec6-91b9-6dd364dc2615 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lazy-loading 'services' on Instance uuid 91be4b61-f6fb-4860-9346-f172a57ce12a {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 14:59:59.554392 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-53235100-7b65-4414-83e4-eb8d2e4838e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 14:59:59.556312 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-53235100-7b65-4414-83e4-eb8d2e4838e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 14:59:59.565212 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53235100-7b65-4414-83e4-eb8d2e4838e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:59.567076 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53235100-7b65-4414-83e4-eb8d2e4838e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:59.569083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53235100-7b65-4414-83e4-eb8d2e4838e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 14:59:59.570400 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53235100-7b65-4414-83e4-eb8d2e4838e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 14:59:59.583410 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-38a49517-99e1-4ec6-91b9-6dd364dc2615 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "DELETE /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments/5998471d-4331-4abc-b8a9-bd6928eebce5" status: 202 len: 0 microversion: 2.1 time: 0.381861 Apr 12 14:59:59.587336 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 377/750] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Apr 12 14:59:59 2022] DELETE /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments/5998471d-4331-4abc-b8a9-bd6928eebce5 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 14:59:59.774232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-53235100-7b65-4414-83e4-eb8d2e4838e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:59.782788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-53235100-7b65-4414-83e4-eb8d2e4838e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:59.789510 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-53235100-7b65-4414-83e4-eb8d2e4838e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 14:59:59.794495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-53235100-7b65-4414-83e4-eb8d2e4838e3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.246051 Apr 12 14:59:59.795332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 374/751] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 14:59:59 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:00.812598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1fcd3765-631c-45da-9ae7-41bcabbc54f4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:00.813902 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6c75e942-98a1-4ac9-8761-659f3c6b0b94 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:00.814600 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6c75e942-98a1-4ac9-8761-659f3c6b0b94 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:00.815045 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1fcd3765-631c-45da-9ae7-41bcabbc54f4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:00.823438 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1fcd3765-631c-45da-9ae7-41bcabbc54f4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:00.824127 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1fcd3765-631c-45da-9ae7-41bcabbc54f4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:00.825088 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1fcd3765-631c-45da-9ae7-41bcabbc54f4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:00.825717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1fcd3765-631c-45da-9ae7-41bcabbc54f4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:00.826174 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c75e942-98a1-4ac9-8761-659f3c6b0b94 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:00.826735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c75e942-98a1-4ac9-8761-659f3c6b0b94 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:00.827709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c75e942-98a1-4ac9-8761-659f3c6b0b94 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:00.830104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c75e942-98a1-4ac9-8761-659f3c6b0b94 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:00.867776 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1fcd3765-631c-45da-9ae7-41bcabbc54f4 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060800 Apr 12 15:00:00.868952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 378/752] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 15:00:00 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 15:00:01.007788 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c384e914-39a6-44ab-a364-65a29ef56fc1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:01.010843 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6c75e942-98a1-4ac9-8761-659f3c6b0b94 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:01.014448 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c384e914-39a6-44ab-a364-65a29ef56fc1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:01.025445 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6c75e942-98a1-4ac9-8761-659f3c6b0b94 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:01.027279 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c384e914-39a6-44ab-a364-65a29ef56fc1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:01.029013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6c75e942-98a1-4ac9-8761-659f3c6b0b94 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:01.029692 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c384e914-39a6-44ab-a364-65a29ef56fc1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:01.031562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c384e914-39a6-44ab-a364-65a29ef56fc1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:01.032850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c384e914-39a6-44ab-a364-65a29ef56fc1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:01.033408 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6c75e942-98a1-4ac9-8761-659f3c6b0b94 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.222686 Apr 12 15:00:01.052069 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 375/753] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:00 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:01.084013 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c384e914-39a6-44ab-a364-65a29ef56fc1 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080438 Apr 12 15:00:01.085150 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 379/754] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 15:00:01 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 15:00:01.154206 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6416a602-4b0c-4559-a287-7624f2d2ebf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:01.154723 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6416a602-4b0c-4559-a287-7624f2d2ebf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:01.161561 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6416a602-4b0c-4559-a287-7624f2d2ebf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:01.162049 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6416a602-4b0c-4559-a287-7624f2d2ebf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:01.162855 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6416a602-4b0c-4559-a287-7624f2d2ebf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:01.163304 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6416a602-4b0c-4559-a287-7624f2d2ebf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:01.189243 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6416a602-4b0c-4559-a287-7624f2d2ebf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 15:00:01.720050 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6416a602-4b0c-4559-a287-7624f2d2ebf8 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "DELETE /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 204 len: 0 microversion: 2.1 time: 0.569302 Apr 12 15:00:01.720730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 376/755] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:00:01 2022] DELETE /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 15:00:01.729037 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6e5ba4f9-7348-4deb-9d9d-0bb9b7e5d0aa tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:01.729655 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6e5ba4f9-7348-4deb-9d9d-0bb9b7e5d0aa tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:01.735930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e5ba4f9-7348-4deb-9d9d-0bb9b7e5d0aa tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:01.736385 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e5ba4f9-7348-4deb-9d9d-0bb9b7e5d0aa tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:01.737665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e5ba4f9-7348-4deb-9d9d-0bb9b7e5d0aa tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:01.738108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6e5ba4f9-7348-4deb-9d9d-0bb9b7e5d0aa tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:01.878853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6e5ba4f9-7348-4deb-9d9d-0bb9b7e5d0aa tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:01.886451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6e5ba4f9-7348-4deb-9d9d-0bb9b7e5d0aa tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1674 microversion: 2.1 time: 0.161175 Apr 12 15:00:01.887719 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 380/756] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:01 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:02.053947 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5f50145d-194d-4903-b428-97a5ab7592f8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:02.054640 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5f50145d-194d-4903-b428-97a5ab7592f8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:02.064805 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5f50145d-194d-4903-b428-97a5ab7592f8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:02.066969 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5f50145d-194d-4903-b428-97a5ab7592f8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:02.067306 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5f50145d-194d-4903-b428-97a5ab7592f8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:02.067744 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5f50145d-194d-4903-b428-97a5ab7592f8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:02.217132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5f50145d-194d-4903-b428-97a5ab7592f8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:02.226242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5f50145d-194d-4903-b428-97a5ab7592f8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:02.228013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5f50145d-194d-4903-b428-97a5ab7592f8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:02.229397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5f50145d-194d-4903-b428-97a5ab7592f8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.180305 Apr 12 15:00:02.230248 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 377/757] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:02 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:02.910436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0e8d5215-c6ab-483b-ba54-9accf00d63a7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:02.910436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0e8d5215-c6ab-483b-ba54-9accf00d63a7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:02.915095 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e8d5215-c6ab-483b-ba54-9accf00d63a7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:02.915556 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e8d5215-c6ab-483b-ba54-9accf00d63a7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:02.916316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e8d5215-c6ab-483b-ba54-9accf00d63a7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:02.916747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0e8d5215-c6ab-483b-ba54-9accf00d63a7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:03.059620 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0e8d5215-c6ab-483b-ba54-9accf00d63a7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:03.067678 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0e8d5215-c6ab-483b-ba54-9accf00d63a7 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1674 microversion: 2.1 time: 0.163892 Apr 12 15:00:03.068249 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 381/758] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:02 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:03.248693 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fe07b66c-ad13-48b6-9311-19bc54771a76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:03.249474 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fe07b66c-ad13-48b6-9311-19bc54771a76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:03.256893 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fe07b66c-ad13-48b6-9311-19bc54771a76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:03.257484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fe07b66c-ad13-48b6-9311-19bc54771a76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:03.258396 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fe07b66c-ad13-48b6-9311-19bc54771a76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:03.258900 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fe07b66c-ad13-48b6-9311-19bc54771a76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:03.391105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fe07b66c-ad13-48b6-9311-19bc54771a76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:03.399597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fe07b66c-ad13-48b6-9311-19bc54771a76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:03.401098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fe07b66c-ad13-48b6-9311-19bc54771a76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:03.402379 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fe07b66c-ad13-48b6-9311-19bc54771a76 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1741 microversion: 2.20 time: 0.157603 Apr 12 15:00:03.403021 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 378/759] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:03 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:04.086629 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-52d37faf-d42a-4bc0-97c8-879a16ec2537 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:04.087247 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-52d37faf-d42a-4bc0-97c8-879a16ec2537 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:04.094773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52d37faf-d42a-4bc0-97c8-879a16ec2537 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:04.095228 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52d37faf-d42a-4bc0-97c8-879a16ec2537 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:04.096037 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52d37faf-d42a-4bc0-97c8-879a16ec2537 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:04.096537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52d37faf-d42a-4bc0-97c8-879a16ec2537 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:04.249348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-52d37faf-d42a-4bc0-97c8-879a16ec2537 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:04.259843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-52d37faf-d42a-4bc0-97c8-879a16ec2537 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1674 microversion: 2.1 time: 0.177259 Apr 12 15:00:04.260443 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 382/760] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:04 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:04.420787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e5d11575-3198-4fd6-8252-f1ae2a9b715c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:04.421671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e5d11575-3198-4fd6-8252-f1ae2a9b715c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:04.428824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e5d11575-3198-4fd6-8252-f1ae2a9b715c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:04.429274 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e5d11575-3198-4fd6-8252-f1ae2a9b715c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:04.430077 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e5d11575-3198-4fd6-8252-f1ae2a9b715c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:04.430512 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e5d11575-3198-4fd6-8252-f1ae2a9b715c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:04.571599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e5d11575-3198-4fd6-8252-f1ae2a9b715c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:04.580392 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e5d11575-3198-4fd6-8252-f1ae2a9b715c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:04.581969 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e5d11575-3198-4fd6-8252-f1ae2a9b715c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:04.583145 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e5d11575-3198-4fd6-8252-f1ae2a9b715c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1723 microversion: 2.20 time: 0.166560 Apr 12 15:00:04.583696 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 379/761] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:04 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:05.286697 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fee0329e-f5d2-4d0f-b272-077007b576cc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:05.287419 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fee0329e-f5d2-4d0f-b272-077007b576cc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:05.294878 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fee0329e-f5d2-4d0f-b272-077007b576cc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:05.295599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fee0329e-f5d2-4d0f-b272-077007b576cc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:05.296732 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fee0329e-f5d2-4d0f-b272-077007b576cc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:05.297318 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fee0329e-f5d2-4d0f-b272-077007b576cc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:05.345477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-c0b69e80-3884-4139-a149-a2b366c22bb4 req-a61145f3-232e-4ad1-9504-f9ac0178d9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91be4b61-f6fb-4860-9346-f172a57ce12a", "name": "network-vif-deleted", "tag": "95cec772-b36b-4db9-bc7d-ba457a268029"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:05.372313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-c0b69e80-3884-4139-a149-a2b366c22bb4 req-a61145f3-232e-4ad1-9504-f9ac0178d9cb service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:05.372812 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-c0b69e80-3884-4139-a149-a2b366c22bb4 req-a61145f3-232e-4ad1-9504-f9ac0178d9cb service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:05.389229 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-c0b69e80-3884-4139-a149-a2b366c22bb4 req-a61145f3-232e-4ad1-9504-f9ac0178d9cb service nova] Creating event network-vif-deleted:95cec772-b36b-4db9-bc7d-ba457a268029 for instance 91be4b61-f6fb-4860-9346-f172a57ce12a on hv-cinder-83752 Apr 12 15:00:05.392657 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fee0329e-f5d2-4d0f-b272-077007b576cc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:05.396122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-c0b69e80-3884-4139-a149-a2b366c22bb4 req-a61145f3-232e-4ad1-9504-f9ac0178d9cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189128 Apr 12 15:00:05.398678 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 383/762] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:00:05.406047 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fee0329e-f5d2-4d0f-b272-077007b576cc tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1606 microversion: 2.1 time: 0.125085 Apr 12 15:00:05.406736 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 380/763] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:05 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1606 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:05.602704 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-549431d9-5c5c-40e3-97e0-47d8cef91af6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:05.603782 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-549431d9-5c5c-40e3-97e0-47d8cef91af6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:05.610048 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-549431d9-5c5c-40e3-97e0-47d8cef91af6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:05.610524 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-549431d9-5c5c-40e3-97e0-47d8cef91af6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:05.611295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-549431d9-5c5c-40e3-97e0-47d8cef91af6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:05.611730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-549431d9-5c5c-40e3-97e0-47d8cef91af6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:05.744859 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-549431d9-5c5c-40e3-97e0-47d8cef91af6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:05.752600 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-549431d9-5c5c-40e3-97e0-47d8cef91af6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:05.755362 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-549431d9-5c5c-40e3-97e0-47d8cef91af6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:05.756514 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-549431d9-5c5c-40e3-97e0-47d8cef91af6 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1723 microversion: 2.20 time: 0.158554 Apr 12 15:00:05.757172 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 384/764] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:05 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:06.426173 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-eb137a18-9fe4-41da-a1eb-66643aeb0840 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:06.426788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-eb137a18-9fe4-41da-a1eb-66643aeb0840 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:06.433215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eb137a18-9fe4-41da-a1eb-66643aeb0840 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:06.433692 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eb137a18-9fe4-41da-a1eb-66643aeb0840 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:06.434466 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eb137a18-9fe4-41da-a1eb-66643aeb0840 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:06.434893 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eb137a18-9fe4-41da-a1eb-66643aeb0840 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:06.508213 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-eb137a18-9fe4-41da-a1eb-66643aeb0840 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:06.518685 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-eb137a18-9fe4-41da-a1eb-66643aeb0840 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1606 microversion: 2.1 time: 0.096880 Apr 12 15:00:06.531834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 381/765] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:06 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1606 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:06.775245 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-08dce083-f85c-4ab2-b3da-8418f7390534 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:06.781599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-08dce083-f85c-4ab2-b3da-8418f7390534 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:06.782417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08dce083-f85c-4ab2-b3da-8418f7390534 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:06.782861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08dce083-f85c-4ab2-b3da-8418f7390534 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:06.783622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08dce083-f85c-4ab2-b3da-8418f7390534 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:06.784815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08dce083-f85c-4ab2-b3da-8418f7390534 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:06.913288 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-08dce083-f85c-4ab2-b3da-8418f7390534 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:06.921056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-08dce083-f85c-4ab2-b3da-8418f7390534 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:06.922589 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-08dce083-f85c-4ab2-b3da-8418f7390534 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:06.923731 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-08dce083-f85c-4ab2-b3da-8418f7390534 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1723 microversion: 2.20 time: 0.152500 Apr 12 15:00:06.924285 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 385/766] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:06 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:07.543211 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:07.543824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:07.550692 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:07.551140 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:07.551912 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:07.552345 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:07.582240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:07.582688 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:07.583135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lazy-loading 'fault' on Instance uuid 91be4b61-f6fb-4860-9346-f172a57ce12a {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 15:00:07.625685 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:07.633679 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-90a99466-fd3b-4704-95d4-9fb2e2fed4fb tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1328 microversion: 2.1 time: 0.094270 Apr 12 15:00:07.634237 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 382/767] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:07 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:07.942717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f5c81d53-3964-4f5f-b30c-bda5b9072433 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:07.943246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f5c81d53-3964-4f5f-b30c-bda5b9072433 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:07.949598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5c81d53-3964-4f5f-b30c-bda5b9072433 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:07.950079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5c81d53-3964-4f5f-b30c-bda5b9072433 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:07.950836 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5c81d53-3964-4f5f-b30c-bda5b9072433 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:07.951264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5c81d53-3964-4f5f-b30c-bda5b9072433 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:08.078269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f5c81d53-3964-4f5f-b30c-bda5b9072433 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:08.087176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f5c81d53-3964-4f5f-b30c-bda5b9072433 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:08.088670 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f5c81d53-3964-4f5f-b30c-bda5b9072433 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:08.089838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f5c81d53-3964-4f5f-b30c-bda5b9072433 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1726 microversion: 2.20 time: 0.151222 Apr 12 15:00:08.090415 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 386/768] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:07 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:08.107636 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3cb22b5b-939d-4658-94e6-970482b8bfab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "869a30bb-75d9-4ca0-902b-2018c4fba76a"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:08.108747 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3cb22b5b-939d-4658-94e6-970482b8bfab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:08.114656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cb22b5b-939d-4658-94e6-970482b8bfab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:08.115101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cb22b5b-939d-4658-94e6-970482b8bfab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:08.115864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cb22b5b-939d-4658-94e6-970482b8bfab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:08.116297 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cb22b5b-939d-4658-94e6-970482b8bfab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:08.652054 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:08.652666 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:08.658673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:08.659652 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:08.660412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:08.660871 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:08.759956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:08.759956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:08.759956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lazy-loading 'fault' on Instance uuid 91be4b61-f6fb-4860-9346-f172a57ce12a {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 15:00:08.760243 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:08.760243 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-64b115a0-77bc-4bb0-b905-185b3ec0ec24 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1328 microversion: 2.1 time: 0.092357 Apr 12 15:00:08.760243 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 387/769] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:08 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:09.355102 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3cb22b5b-939d-4658-94e6-970482b8bfab tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "POST /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.251423 Apr 12 15:00:09.355651 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 383/770] 10.222.0.64 () {62 vars in 1363 bytes} [Tue Apr 12 15:00:08 2022] POST /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/os-volume_attachments => generated 188 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:00:09.480557 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f591f4b7-1bde-480b-b120-527553e7ed35 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:09.481189 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f591f4b7-1bde-480b-b120-527553e7ed35 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:09.488403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f591f4b7-1bde-480b-b120-527553e7ed35 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:09.492956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f591f4b7-1bde-480b-b120-527553e7ed35 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:09.492956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f591f4b7-1bde-480b-b120-527553e7ed35 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:09.492956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f591f4b7-1bde-480b-b120-527553e7ed35 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:09.662683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-469bd4c5-e2d1-4be8-a9c4-a976cc8453c3 req-3f48c710-a8fb-464a-9bed-cbb4c2a909c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946d8ea7-5cb9-4e2f-99b4-27f342c44b63", "name": "network-vif-unplugged", "status": "completed", "tag": "5c58da46-e5bb-4b4a-8051-745b00e75ae2"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:09.671205 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-469bd4c5-e2d1-4be8-a9c4-a976cc8453c3 req-3f48c710-a8fb-464a-9bed-cbb4c2a909c7 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:09.671639 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-469bd4c5-e2d1-4be8-a9c4-a976cc8453c3 req-3f48c710-a8fb-464a-9bed-cbb4c2a909c7 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:09.683131 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-469bd4c5-e2d1-4be8-a9c4-a976cc8453c3 req-3f48c710-a8fb-464a-9bed-cbb4c2a909c7 service nova] Creating event network-vif-unplugged:5c58da46-e5bb-4b4a-8051-745b00e75ae2 for instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 on hv-cinder-83752 Apr 12 15:00:09.688129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-469bd4c5-e2d1-4be8-a9c4-a976cc8453c3 req-3f48c710-a8fb-464a-9bed-cbb4c2a909c7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091158 Apr 12 15:00:09.688703 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 384/771] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 15:00:09.764868 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:09.765555 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:09.772840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:09.775750 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:09.775750 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:09.775750 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:09.805940 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:09.806390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:09.806837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lazy-loading 'fault' on Instance uuid 91be4b61-f6fb-4860-9346-f172a57ce12a {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 15:00:09.854959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317bfa69daa49f286fd8c216e9f415a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fcc2a0fdd24f72a683109da0ad023e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:09.867802 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-afd7037a-9d97-409d-9e39-587a665f684b tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 200 len: 1328 microversion: 2.1 time: 0.106997 Apr 12 15:00:09.869053 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 385/772] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:09 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:10.212087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f591f4b7-1bde-480b-b120-527553e7ed35 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "DELETE /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/os-volume_attachments/869a30bb-75d9-4ca0-902b-2018c4fba76a" status: 202 len: 0 microversion: 2.20 time: 0.735505 Apr 12 15:00:10.212585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 388/773] 10.222.0.64 () {60 vars in 1456 bytes} [Tue Apr 12 15:00:09 2022] DELETE /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/os-volume_attachments/869a30bb-75d9-4ca0-902b-2018c4fba76a => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 15:00:10.272577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1e018c64-421b-4083-90c0-5d5d2630ba26 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:10.273274 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1e018c64-421b-4083-90c0-5d5d2630ba26 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:10.279187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1e018c64-421b-4083-90c0-5d5d2630ba26 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:10.279629 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1e018c64-421b-4083-90c0-5d5d2630ba26 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:10.280510 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1e018c64-421b-4083-90c0-5d5d2630ba26 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:10.281085 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1e018c64-421b-4083-90c0-5d5d2630ba26 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:10.483099 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1e018c64-421b-4083-90c0-5d5d2630ba26 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "POST /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/action" status: 202 len: 0 microversion: 2.20 time: 0.215219 Apr 12 15:00:10.483755 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 386/774] 10.222.0.64 () {62 vars in 1318 bytes} [Tue Apr 12 15:00:10 2022] POST /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 15:00:10.491924 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fda3dd32-8cb7-4add-84b8-ba55d0694eb0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:10.492528 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fda3dd32-8cb7-4add-84b8-ba55d0694eb0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:10.499293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fda3dd32-8cb7-4add-84b8-ba55d0694eb0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:10.499962 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fda3dd32-8cb7-4add-84b8-ba55d0694eb0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:10.500742 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fda3dd32-8cb7-4add-84b8-ba55d0694eb0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:10.501174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fda3dd32-8cb7-4add-84b8-ba55d0694eb0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:10.639087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fda3dd32-8cb7-4add-84b8-ba55d0694eb0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:10.648721 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fda3dd32-8cb7-4add-84b8-ba55d0694eb0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:10.650640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fda3dd32-8cb7-4add-84b8-ba55d0694eb0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:10.651927 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fda3dd32-8cb7-4add-84b8-ba55d0694eb0 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1674 microversion: 2.20 time: 0.163926 Apr 12 15:00:10.652572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 389/775] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:10 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:10.849272 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f4f0f2a7-6a5f-4a65-86ae-67fad84a3ed6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:10.849912 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f4f0f2a7-6a5f-4a65-86ae-67fad84a3ed6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:10.855695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f4f0f2a7-6a5f-4a65-86ae-67fad84a3ed6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:10.856147 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f4f0f2a7-6a5f-4a65-86ae-67fad84a3ed6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:10.856967 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f4f0f2a7-6a5f-4a65-86ae-67fad84a3ed6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:10.857438 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f4f0f2a7-6a5f-4a65-86ae-67fad84a3ed6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:10.882711 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-f4f0f2a7-6a5f-4a65-86ae-67fad84a3ed6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lazy-loading 'flavor' on Instance uuid 7e688875-ca8d-4972-9d02-9c66a8634013 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 15:00:10.895640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-018bcc37-e8a5-477b-ac5a-a7b5922e061d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:10.896252 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-018bcc37-e8a5-477b-ac5a-a7b5922e061d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:10.902771 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-018bcc37-e8a5-477b-ac5a-a7b5922e061d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:10.903221 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-018bcc37-e8a5-477b-ac5a-a7b5922e061d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:10.904295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-018bcc37-e8a5-477b-ac5a-a7b5922e061d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:10.904706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-018bcc37-e8a5-477b-ac5a-a7b5922e061d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:10.918337 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-018bcc37-e8a5-477b-ac5a-a7b5922e061d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] HTTP exception thrown: Instance 91be4b61-f6fb-4860-9346-f172a57ce12a could not be found. Apr 12 15:00:10.918927 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-018bcc37-e8a5-477b-ac5a-a7b5922e061d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Returning 404 to user: Instance 91be4b61-f6fb-4860-9346-f172a57ce12a could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:10.919751 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-018bcc37-e8a5-477b-ac5a-a7b5922e061d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 404 len: 111 microversion: 2.1 time: 0.030299 Apr 12 15:00:10.920669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 390/776] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:10 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:00:10.932825 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-40869bdd-7214-4ced-8767-49e3c7706e63 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '.version_select at 0x7fbd60836f70>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:11.035849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-40869bdd-7214-4ced-8767-49e3c7706e63 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876850993" status: 202 len: 0 microversion: 2.1 time: 0.107249 Apr 12 15:00:11.038409 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 391/777] 10.222.0.64 () {58 vars in 1220 bytes} [Tue Apr 12 15:00:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876850993 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 15:00:11.226585 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f4f0f2a7-6a5f-4a65-86ae-67fad84a3ed6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "POST /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013/action" status: 202 len: 0 microversion: 2.1 time: 0.381566 Apr 12 15:00:11.227200 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 387/778] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 15:00:10 2022] POST /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 15:00:11.235445 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-81ea6ae8-deed-464d-8ff2-4f7ec5a2f6e7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:11.236056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-81ea6ae8-deed-464d-8ff2-4f7ec5a2f6e7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:11.242921 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81ea6ae8-deed-464d-8ff2-4f7ec5a2f6e7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:11.243372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81ea6ae8-deed-464d-8ff2-4f7ec5a2f6e7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:11.244148 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81ea6ae8-deed-464d-8ff2-4f7ec5a2f6e7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:11.244581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81ea6ae8-deed-464d-8ff2-4f7ec5a2f6e7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:11.402263 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-81ea6ae8-deed-464d-8ff2-4f7ec5a2f6e7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:11.410361 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-81ea6ae8-deed-464d-8ff2-4f7ec5a2f6e7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.178752 Apr 12 15:00:11.410937 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 392/779] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:11 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:11.671403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0b3d7a2c-6055-451c-83c7-0f4ef6aa5a1f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:11.672094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0b3d7a2c-6055-451c-83c7-0f4ef6aa5a1f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:11.684573 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0b3d7a2c-6055-451c-83c7-0f4ef6aa5a1f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:11.687002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0b3d7a2c-6055-451c-83c7-0f4ef6aa5a1f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:11.687822 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0b3d7a2c-6055-451c-83c7-0f4ef6aa5a1f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:11.688276 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0b3d7a2c-6055-451c-83c7-0f4ef6aa5a1f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:11.728457 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9aa0f6e1-5fba-45b2-99d2-636d911ced35 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:11.729158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9aa0f6e1-5fba-45b2-99d2-636d911ced35 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:11.736114 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9aa0f6e1-5fba-45b2-99d2-636d911ced35 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:11.742238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9aa0f6e1-5fba-45b2-99d2-636d911ced35 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:11.742238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9aa0f6e1-5fba-45b2-99d2-636d911ced35 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:11.742238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9aa0f6e1-5fba-45b2-99d2-636d911ced35 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:11.775278 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9aa0f6e1-5fba-45b2-99d2-636d911ced35 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/ips" status: 200 len: 149 microversion: 2.1 time: 0.196020 Apr 12 15:00:11.776129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 388/780] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Apr 12 15:00:11 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/ips => generated 149 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:00:11.864978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0b3d7a2c-6055-451c-83c7-0f4ef6aa5a1f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:11.873934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0b3d7a2c-6055-451c-83c7-0f4ef6aa5a1f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:11.875717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0b3d7a2c-6055-451c-83c7-0f4ef6aa5a1f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:11.878843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0b3d7a2c-6055-451c-83c7-0f4ef6aa5a1f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1674 microversion: 2.20 time: 0.211092 Apr 12 15:00:11.880094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 393/781] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:11 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:12.430246 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5b57700a-3604-4687-a074-5532a8dc5aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:12.430947 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5b57700a-3604-4687-a074-5532a8dc5aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:12.439538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5b57700a-3604-4687-a074-5532a8dc5aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:12.440913 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5b57700a-3604-4687-a074-5532a8dc5aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:12.442599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5b57700a-3604-4687-a074-5532a8dc5aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:12.443245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5b57700a-3604-4687-a074-5532a8dc5aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:12.604107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5b57700a-3604-4687-a074-5532a8dc5aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:12.616900 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5b57700a-3604-4687-a074-5532a8dc5aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.193324 Apr 12 15:00:12.617549 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 389/782] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:12 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:12.897505 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9142eeca-78aa-4317-9d6b-de7d2cfdf2e2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:12.898265 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9142eeca-78aa-4317-9d6b-de7d2cfdf2e2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:12.904792 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9142eeca-78aa-4317-9d6b-de7d2cfdf2e2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:12.905246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9142eeca-78aa-4317-9d6b-de7d2cfdf2e2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:12.906050 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9142eeca-78aa-4317-9d6b-de7d2cfdf2e2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:12.906482 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9142eeca-78aa-4317-9d6b-de7d2cfdf2e2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:13.049381 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9142eeca-78aa-4317-9d6b-de7d2cfdf2e2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:13.058919 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9142eeca-78aa-4317-9d6b-de7d2cfdf2e2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:13.060498 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9142eeca-78aa-4317-9d6b-de7d2cfdf2e2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:13.061711 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9142eeca-78aa-4317-9d6b-de7d2cfdf2e2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.168169 Apr 12 15:00:13.062286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 394/783] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:12 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:13.458610 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-35effff2-691e-4ad2-8890-1791b15dfa2f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a92464b-cd4c-41b2-ab4c-eaf48919d9a1"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:13.460156 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-35effff2-691e-4ad2-8890-1791b15dfa2f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:13.468147 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35effff2-691e-4ad2-8890-1791b15dfa2f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:13.468851 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35effff2-691e-4ad2-8890-1791b15dfa2f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:13.470388 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35effff2-691e-4ad2-8890-1791b15dfa2f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:13.470983 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35effff2-691e-4ad2-8890-1791b15dfa2f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:13.636019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2408a732-3e6a-4132-9914-58850348e14a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:13.636683 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2408a732-3e6a-4132-9914-58850348e14a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:13.644425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2408a732-3e6a-4132-9914-58850348e14a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:13.645199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2408a732-3e6a-4132-9914-58850348e14a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:13.646778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2408a732-3e6a-4132-9914-58850348e14a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:13.647562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2408a732-3e6a-4132-9914-58850348e14a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:13.818122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2408a732-3e6a-4132-9914-58850348e14a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:13.831534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2408a732-3e6a-4132-9914-58850348e14a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.199601 Apr 12 15:00:13.834734 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 395/784] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:13 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:14.080709 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d16f65db-0d2c-42b0-b5ce-c6e4d88ccd4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:14.083015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d16f65db-0d2c-42b0-b5ce-c6e4d88ccd4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:14.090231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d16f65db-0d2c-42b0-b5ce-c6e4d88ccd4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:14.091041 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d16f65db-0d2c-42b0-b5ce-c6e4d88ccd4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:14.091912 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d16f65db-0d2c-42b0-b5ce-c6e4d88ccd4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:14.092422 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d16f65db-0d2c-42b0-b5ce-c6e4d88ccd4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:14.264309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d16f65db-0d2c-42b0-b5ce-c6e4d88ccd4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:14.274466 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d16f65db-0d2c-42b0-b5ce-c6e4d88ccd4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:14.275978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d16f65db-0d2c-42b0-b5ce-c6e4d88ccd4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:14.277259 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d16f65db-0d2c-42b0-b5ce-c6e4d88ccd4a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.200612 Apr 12 15:00:14.278675 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 396/785] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:14 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:14.822337 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bf4a6ad0-47b6-46eb-b5eb-612a09ee4b1d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:14.822839 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bf4a6ad0-47b6-46eb-b5eb-612a09ee4b1d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:14.828694 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf4a6ad0-47b6-46eb-b5eb-612a09ee4b1d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:14.829145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf4a6ad0-47b6-46eb-b5eb-612a09ee4b1d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:14.829943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf4a6ad0-47b6-46eb-b5eb-612a09ee4b1d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:14.830379 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf4a6ad0-47b6-46eb-b5eb-612a09ee4b1d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:14.844389 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-bf4a6ad0-47b6-46eb-b5eb-612a09ee4b1d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] HTTP exception thrown: Instance 91be4b61-f6fb-4860-9346-f172a57ce12a could not be found. Apr 12 15:00:14.844979 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bf4a6ad0-47b6-46eb-b5eb-612a09ee4b1d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Returning 404 to user: Instance 91be4b61-f6fb-4860-9346-f172a57ce12a could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:14.845875 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bf4a6ad0-47b6-46eb-b5eb-612a09ee4b1d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "DELETE /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 404 len: 111 microversion: 2.1 time: 0.027590 Apr 12 15:00:14.846471 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 397/786] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:00:14 2022] DELETE /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 15:00:14.851229 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b89a382d-3109-4a0a-9494-8bef3fdaf5b6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:14.851842 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b89a382d-3109-4a0a-9494-8bef3fdaf5b6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:14.859403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b89a382d-3109-4a0a-9494-8bef3fdaf5b6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:14.860139 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b89a382d-3109-4a0a-9494-8bef3fdaf5b6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:14.861421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b89a382d-3109-4a0a-9494-8bef3fdaf5b6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:14.862212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b89a382d-3109-4a0a-9494-8bef3fdaf5b6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:15.010244 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b89a382d-3109-4a0a-9494-8bef3fdaf5b6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:15.020500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b89a382d-3109-4a0a-9494-8bef3fdaf5b6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.172949 Apr 12 15:00:15.021367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 398/787] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:14 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:15.025992 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7614a409-6b34-46b9-aea5-d8288a266328 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:15.026597 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7614a409-6b34-46b9-aea5-d8288a266328 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: 91be4b61-f6fb-4860-9346-f172a57ce12a] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:15.032585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7614a409-6b34-46b9-aea5-d8288a266328 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:15.033032 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7614a409-6b34-46b9-aea5-d8288a266328 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:15.033863 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7614a409-6b34-46b9-aea5-d8288a266328 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:15.034958 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7614a409-6b34-46b9-aea5-d8288a266328 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:15.049795 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-7614a409-6b34-46b9-aea5-d8288a266328 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] HTTP exception thrown: Instance 91be4b61-f6fb-4860-9346-f172a57ce12a could not be found. Apr 12 15:00:15.050468 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7614a409-6b34-46b9-aea5-d8288a266328 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Returning 404 to user: Instance 91be4b61-f6fb-4860-9346-f172a57ce12a could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:15.051555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7614a409-6b34-46b9-aea5-d8288a266328 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a" status: 404 len: 111 microversion: 2.1 time: 0.029247 Apr 12 15:00:15.052321 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 399/788] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:15 2022] GET /compute/v2.1/servers/91be4b61-f6fb-4860-9346-f172a57ce12a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:00:15.298276 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-adc2cbab-1aac-4d58-8bbd-c43d1ad02402 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:15.298817 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-adc2cbab-1aac-4d58-8bbd-c43d1ad02402 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:15.306624 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adc2cbab-1aac-4d58-8bbd-c43d1ad02402 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:15.307376 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adc2cbab-1aac-4d58-8bbd-c43d1ad02402 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:15.308528 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adc2cbab-1aac-4d58-8bbd-c43d1ad02402 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:15.309246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adc2cbab-1aac-4d58-8bbd-c43d1ad02402 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:15.473952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-adc2cbab-1aac-4d58-8bbd-c43d1ad02402 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:15.483770 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-adc2cbab-1aac-4d58-8bbd-c43d1ad02402 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:15.485434 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-adc2cbab-1aac-4d58-8bbd-c43d1ad02402 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:15.486903 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-adc2cbab-1aac-4d58-8bbd-c43d1ad02402 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.193267 Apr 12 15:00:15.488382 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 400/789] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:15 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:16.040598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b661742d-b735-4951-bc6d-57a1ea8020a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:16.041354 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b661742d-b735-4951-bc6d-57a1ea8020a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:16.047523 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b661742d-b735-4951-bc6d-57a1ea8020a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:16.048049 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b661742d-b735-4951-bc6d-57a1ea8020a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:16.049020 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b661742d-b735-4951-bc6d-57a1ea8020a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:16.049500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b661742d-b735-4951-bc6d-57a1ea8020a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:16.243976 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b661742d-b735-4951-bc6d-57a1ea8020a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:16.254621 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b661742d-b735-4951-bc6d-57a1ea8020a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.219000 Apr 12 15:00:16.255970 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 401/790] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:16 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:16.395823 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-87ef111d-dd8d-46c1-9a35-5a047c485031 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:16.396403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-87ef111d-dd8d-46c1-9a35-5a047c485031 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:16.403442 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87ef111d-dd8d-46c1-9a35-5a047c485031 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:16.403977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87ef111d-dd8d-46c1-9a35-5a047c485031 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:16.404837 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87ef111d-dd8d-46c1-9a35-5a047c485031 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:16.405344 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87ef111d-dd8d-46c1-9a35-5a047c485031 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:16.421278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-87ef111d-dd8d-46c1-9a35-5a047c485031 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] HTTP exception thrown: Instance cc3e6773-eb1f-4098-b443-1b2d62d1abe8 could not be found. Apr 12 15:00:16.422132 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-87ef111d-dd8d-46c1-9a35-5a047c485031 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Returning 404 to user: Instance cc3e6773-eb1f-4098-b443-1b2d62d1abe8 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:16.423028 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-87ef111d-dd8d-46c1-9a35-5a047c485031 tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "DELETE /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 404 len: 111 microversion: 2.1 time: 0.031807 Apr 12 15:00:16.425767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 402/791] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:00:16 2022] DELETE /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 15:00:16.433235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-61643637-0df9-4e6e-8311-6b637ca2d90d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:16.433743 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-61643637-0df9-4e6e-8311-6b637ca2d90d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] [instance: cc3e6773-eb1f-4098-b443-1b2d62d1abe8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:16.439969 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-61643637-0df9-4e6e-8311-6b637ca2d90d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:16.442477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-61643637-0df9-4e6e-8311-6b637ca2d90d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:16.443275 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-61643637-0df9-4e6e-8311-6b637ca2d90d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:16.443852 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-61643637-0df9-4e6e-8311-6b637ca2d90d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:16.468701 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-61643637-0df9-4e6e-8311-6b637ca2d90d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] HTTP exception thrown: Instance cc3e6773-eb1f-4098-b443-1b2d62d1abe8 could not be found. Apr 12 15:00:16.469831 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-61643637-0df9-4e6e-8311-6b637ca2d90d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] Returning 404 to user: Instance cc3e6773-eb1f-4098-b443-1b2d62d1abe8 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:16.470843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-61643637-0df9-4e6e-8311-6b637ca2d90d tempest-AttachVolumeTestJSON-2108516226 tempest-AttachVolumeTestJSON-2108516226-project] 10.222.0.64 "GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8" status: 404 len: 111 microversion: 2.1 time: 0.041857 Apr 12 15:00:16.471717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 403/792] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:16 2022] GET /compute/v2.1/servers/cc3e6773-eb1f-4098-b443-1b2d62d1abe8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 15:00:16.507243 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c03e05ee-21ab-4f0d-ae9d-20f28711ef70 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:16.508246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c03e05ee-21ab-4f0d-ae9d-20f28711ef70 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:16.516799 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c03e05ee-21ab-4f0d-ae9d-20f28711ef70 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:16.517919 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c03e05ee-21ab-4f0d-ae9d-20f28711ef70 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:16.520350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c03e05ee-21ab-4f0d-ae9d-20f28711ef70 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:16.521051 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c03e05ee-21ab-4f0d-ae9d-20f28711ef70 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:16.817235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c03e05ee-21ab-4f0d-ae9d-20f28711ef70 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:16.828451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c03e05ee-21ab-4f0d-ae9d-20f28711ef70 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:16.830451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c03e05ee-21ab-4f0d-ae9d-20f28711ef70 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:16.840667 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c03e05ee-21ab-4f0d-ae9d-20f28711ef70 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.338572 Apr 12 15:00:16.842020 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 404/793] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:16 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:17.273495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-043a6542-ccc5-49d2-a417-a7daf6556ce5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:17.276391 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-043a6542-ccc5-49d2-a417-a7daf6556ce5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:17.281464 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-043a6542-ccc5-49d2-a417-a7daf6556ce5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:17.282165 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-043a6542-ccc5-49d2-a417-a7daf6556ce5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:17.283385 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-043a6542-ccc5-49d2-a417-a7daf6556ce5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:17.284558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-043a6542-ccc5-49d2-a417-a7daf6556ce5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:17.547724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-043a6542-ccc5-49d2-a417-a7daf6556ce5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:17.564453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-043a6542-ccc5-49d2-a417-a7daf6556ce5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.292872 Apr 12 15:00:17.566298 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 405/794] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:17 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:17.858402 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0d78b62f-b28e-4b6d-bd7d-9e2f2953db10 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:17.859001 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0d78b62f-b28e-4b6d-bd7d-9e2f2953db10 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:17.866576 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d78b62f-b28e-4b6d-bd7d-9e2f2953db10 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:17.867018 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d78b62f-b28e-4b6d-bd7d-9e2f2953db10 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:17.867792 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d78b62f-b28e-4b6d-bd7d-9e2f2953db10 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:17.868219 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d78b62f-b28e-4b6d-bd7d-9e2f2953db10 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:18.052376 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0d78b62f-b28e-4b6d-bd7d-9e2f2953db10 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:18.063493 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0d78b62f-b28e-4b6d-bd7d-9e2f2953db10 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:18.063493 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0d78b62f-b28e-4b6d-bd7d-9e2f2953db10 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:18.064145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0d78b62f-b28e-4b6d-bd7d-9e2f2953db10 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.209509 Apr 12 15:00:18.079949 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 406/795] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:17 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:18.585791 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d3866f11-1a9c-4fe0-8391-7fd84257bb42 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:18.586546 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d3866f11-1a9c-4fe0-8391-7fd84257bb42 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:18.593585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d3866f11-1a9c-4fe0-8391-7fd84257bb42 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:18.607957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d3866f11-1a9c-4fe0-8391-7fd84257bb42 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:18.607957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d3866f11-1a9c-4fe0-8391-7fd84257bb42 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:18.607957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d3866f11-1a9c-4fe0-8391-7fd84257bb42 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:18.831424 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d3866f11-1a9c-4fe0-8391-7fd84257bb42 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:18.840156 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d3866f11-1a9c-4fe0-8391-7fd84257bb42 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.260721 Apr 12 15:00:18.842995 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 407/796] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:18 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:19.085688 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-aa5f91ab-6a1d-4c30-94a3-d89a78f11353 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:19.086468 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-aa5f91ab-6a1d-4c30-94a3-d89a78f11353 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:19.093659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aa5f91ab-6a1d-4c30-94a3-d89a78f11353 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:19.094150 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aa5f91ab-6a1d-4c30-94a3-d89a78f11353 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:19.095108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aa5f91ab-6a1d-4c30-94a3-d89a78f11353 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:19.095599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aa5f91ab-6a1d-4c30-94a3-d89a78f11353 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:19.406608 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aa5f91ab-6a1d-4c30-94a3-d89a78f11353 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:19.417151 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aa5f91ab-6a1d-4c30-94a3-d89a78f11353 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:19.418230 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aa5f91ab-6a1d-4c30-94a3-d89a78f11353 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:19.419655 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-aa5f91ab-6a1d-4c30-94a3-d89a78f11353 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.339446 Apr 12 15:00:19.420451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 408/797] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:19 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:19.865200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8643e27d-be53-41be-9883-078f84ca4e87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:19.865200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8643e27d-be53-41be-9883-078f84ca4e87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:19.875695 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8643e27d-be53-41be-9883-078f84ca4e87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:19.876149 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8643e27d-be53-41be-9883-078f84ca4e87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:19.876934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8643e27d-be53-41be-9883-078f84ca4e87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:19.877605 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8643e27d-be53-41be-9883-078f84ca4e87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:20.111236 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8643e27d-be53-41be-9883-078f84ca4e87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:20.119056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8643e27d-be53-41be-9883-078f84ca4e87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.262558 Apr 12 15:00:20.129154 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 409/798] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:19 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:20.441231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8963edca-3f65-4612-ac89-c77838f0f00e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:20.441982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8963edca-3f65-4612-ac89-c77838f0f00e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:20.452180 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8963edca-3f65-4612-ac89-c77838f0f00e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:20.455201 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8963edca-3f65-4612-ac89-c77838f0f00e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:20.456265 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8963edca-3f65-4612-ac89-c77838f0f00e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:20.457861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8963edca-3f65-4612-ac89-c77838f0f00e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:20.717700 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8963edca-3f65-4612-ac89-c77838f0f00e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:20.729127 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8963edca-3f65-4612-ac89-c77838f0f00e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:20.732883 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8963edca-3f65-4612-ac89-c77838f0f00e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:20.734411 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8963edca-3f65-4612-ac89-c77838f0f00e tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.297906 Apr 12 15:00:20.735165 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 410/799] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:20 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:21.137087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-78fb275e-9df5-4e46-8576-0b603ca9ab8d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:21.139393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-78fb275e-9df5-4e46-8576-0b603ca9ab8d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:21.153465 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-78fb275e-9df5-4e46-8576-0b603ca9ab8d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:21.154837 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-78fb275e-9df5-4e46-8576-0b603ca9ab8d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:21.155866 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-78fb275e-9df5-4e46-8576-0b603ca9ab8d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:21.156521 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-78fb275e-9df5-4e46-8576-0b603ca9ab8d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:21.390810 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-78fb275e-9df5-4e46-8576-0b603ca9ab8d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:21.399179 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-78fb275e-9df5-4e46-8576-0b603ca9ab8d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.266553 Apr 12 15:00:21.402474 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 411/800] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:21 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:21.758328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-186ade1b-51d6-429d-a5e5-4560fc4d880f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:21.758656 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-186ade1b-51d6-429d-a5e5-4560fc4d880f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:21.779330 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-186ade1b-51d6-429d-a5e5-4560fc4d880f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:21.789421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-186ade1b-51d6-429d-a5e5-4560fc4d880f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:21.789421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-186ade1b-51d6-429d-a5e5-4560fc4d880f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:21.789421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-186ade1b-51d6-429d-a5e5-4560fc4d880f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:21.970912 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-186ade1b-51d6-429d-a5e5-4560fc4d880f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:21.974774 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-186ade1b-51d6-429d-a5e5-4560fc4d880f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:21.976489 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-186ade1b-51d6-429d-a5e5-4560fc4d880f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:21.977783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-186ade1b-51d6-429d-a5e5-4560fc4d880f tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.227126 Apr 12 15:00:21.978242 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 412/801] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:21 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:22.422582 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-27f6173e-5158-48c5-b0a7-ea6bacf3e6a4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:22.423410 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-27f6173e-5158-48c5-b0a7-ea6bacf3e6a4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:22.441197 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-27f6173e-5158-48c5-b0a7-ea6bacf3e6a4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:22.441197 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-27f6173e-5158-48c5-b0a7-ea6bacf3e6a4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:22.441197 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-27f6173e-5158-48c5-b0a7-ea6bacf3e6a4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:22.441197 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-27f6173e-5158-48c5-b0a7-ea6bacf3e6a4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:22.597692 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-27f6173e-5158-48c5-b0a7-ea6bacf3e6a4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:22.605404 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-27f6173e-5158-48c5-b0a7-ea6bacf3e6a4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.186604 Apr 12 15:00:22.605920 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 413/802] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:22 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:22.996347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ef4abd26-0284-415b-9ff3-d3d4e978590a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:22.997312 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ef4abd26-0284-415b-9ff3-d3d4e978590a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:23.005402 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef4abd26-0284-415b-9ff3-d3d4e978590a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:23.006012 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef4abd26-0284-415b-9ff3-d3d4e978590a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:23.006858 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef4abd26-0284-415b-9ff3-d3d4e978590a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:23.007506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef4abd26-0284-415b-9ff3-d3d4e978590a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:23.173440 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ef4abd26-0284-415b-9ff3-d3d4e978590a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:23.181963 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ef4abd26-0284-415b-9ff3-d3d4e978590a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:23.183456 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ef4abd26-0284-415b-9ff3-d3d4e978590a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:23.184598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ef4abd26-0284-415b-9ff3-d3d4e978590a tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.192419 Apr 12 15:00:23.189768 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 414/803] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:22 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:23.310631 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-35effff2-691e-4ad2-8890-1791b15dfa2f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "POST /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.856256 Apr 12 15:00:23.312349 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 390/804] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 15:00:13 2022] POST /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments => generated 194 bytes in 9860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:00:23.623591 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f2f3a8ce-8b51-4abc-8b62-3902746d0832 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:23.624205 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f2f3a8ce-8b51-4abc-8b62-3902746d0832 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:23.632281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2f3a8ce-8b51-4abc-8b62-3902746d0832 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:23.633008 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2f3a8ce-8b51-4abc-8b62-3902746d0832 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:23.633999 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2f3a8ce-8b51-4abc-8b62-3902746d0832 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:23.634602 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2f3a8ce-8b51-4abc-8b62-3902746d0832 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:23.798448 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f2f3a8ce-8b51-4abc-8b62-3902746d0832 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:23.799694 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f2f3a8ce-8b51-4abc-8b62-3902746d0832 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.180306 Apr 12 15:00:23.801670 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 415/805] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:23 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:24.205246 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-03c8c1f1-a510-427b-9b1e-366f4d8695af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:24.205973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-03c8c1f1-a510-427b-9b1e-366f4d8695af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:24.213911 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03c8c1f1-a510-427b-9b1e-366f4d8695af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:24.214484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03c8c1f1-a510-427b-9b1e-366f4d8695af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:24.215264 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03c8c1f1-a510-427b-9b1e-366f4d8695af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:24.215702 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03c8c1f1-a510-427b-9b1e-366f4d8695af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:24.358480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-03c8c1f1-a510-427b-9b1e-366f4d8695af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:24.375709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-03c8c1f1-a510-427b-9b1e-366f4d8695af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:24.375709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-03c8c1f1-a510-427b-9b1e-366f4d8695af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:24.375709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-03c8c1f1-a510-427b-9b1e-366f4d8695af tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.170095 Apr 12 15:00:24.376116 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 391/806] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:24 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 15:00:24.816754 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-52c5f751-e367-413a-9f39-c06fdf66074a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:24.817584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-52c5f751-e367-413a-9f39-c06fdf66074a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:24.824439 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52c5f751-e367-413a-9f39-c06fdf66074a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:24.824882 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52c5f751-e367-413a-9f39-c06fdf66074a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:24.825664 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52c5f751-e367-413a-9f39-c06fdf66074a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:24.826097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52c5f751-e367-413a-9f39-c06fdf66074a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:24.973276 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-52c5f751-e367-413a-9f39-c06fdf66074a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:24.988500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-52c5f751-e367-413a-9f39-c06fdf66074a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.168422 Apr 12 15:00:24.988500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 416/807] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:24 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:25.391967 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fcb12921-9e15-4604-b08a-669087102d45 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:25.392625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fcb12921-9e15-4604-b08a-669087102d45 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:25.399251 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fcb12921-9e15-4604-b08a-669087102d45 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:25.399701 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fcb12921-9e15-4604-b08a-669087102d45 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:25.400524 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fcb12921-9e15-4604-b08a-669087102d45 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:25.400912 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fcb12921-9e15-4604-b08a-669087102d45 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:25.570885 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fcb12921-9e15-4604-b08a-669087102d45 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:25.580258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fcb12921-9e15-4604-b08a-669087102d45 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:25.581838 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fcb12921-9e15-4604-b08a-669087102d45 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:25.588521 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fcb12921-9e15-4604-b08a-669087102d45 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.195262 Apr 12 15:00:25.588521 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 392/808] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:25 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:25.687567 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-2bf6ebcd-3f6e-4f02-8440-aba05ad69e55 req-9a2e4001-876a-4ad8-bdab-943668f8cd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946d8ea7-5cb9-4e2f-99b4-27f342c44b63", "name": "network-vif-plugged", "status": "completed", "tag": "5c58da46-e5bb-4b4a-8051-745b00e75ae2"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:25.696484 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2bf6ebcd-3f6e-4f02-8440-aba05ad69e55 req-9a2e4001-876a-4ad8-bdab-943668f8cd04 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:25.696920 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2bf6ebcd-3f6e-4f02-8440-aba05ad69e55 req-9a2e4001-876a-4ad8-bdab-943668f8cd04 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:25.707659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-2bf6ebcd-3f6e-4f02-8440-aba05ad69e55 req-9a2e4001-876a-4ad8-bdab-943668f8cd04 service nova] Creating event network-vif-plugged:5c58da46-e5bb-4b4a-8051-745b00e75ae2 for instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 on hv-cinder-83752 Apr 12 15:00:25.712665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-2bf6ebcd-3f6e-4f02-8440-aba05ad69e55 req-9a2e4001-876a-4ad8-bdab-943668f8cd04 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028792 Apr 12 15:00:25.713243 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 417/809] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:00:26.001457 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b0292059-ad44-4442-94ca-37c68f6ac8a5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:26.002011 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b0292059-ad44-4442-94ca-37c68f6ac8a5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:26.008783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0292059-ad44-4442-94ca-37c68f6ac8a5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:26.009372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0292059-ad44-4442-94ca-37c68f6ac8a5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:26.010215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0292059-ad44-4442-94ca-37c68f6ac8a5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:26.010677 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b0292059-ad44-4442-94ca-37c68f6ac8a5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:26.153685 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b0292059-ad44-4442-94ca-37c68f6ac8a5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:26.162727 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b0292059-ad44-4442-94ca-37c68f6ac8a5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.165061 Apr 12 15:00:26.163399 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 393/810] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:25 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:26.603007 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1f558648-85fa-426d-adfa-3f777d477901 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:26.603784 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1f558648-85fa-426d-adfa-3f777d477901 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:26.609760 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f558648-85fa-426d-adfa-3f777d477901 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:26.610222 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f558648-85fa-426d-adfa-3f777d477901 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:26.638893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f558648-85fa-426d-adfa-3f777d477901 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:26.638893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1f558648-85fa-426d-adfa-3f777d477901 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:26.745255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1f558648-85fa-426d-adfa-3f777d477901 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:26.753995 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1f558648-85fa-426d-adfa-3f777d477901 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:26.755703 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1f558648-85fa-426d-adfa-3f777d477901 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:26.756879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1f558648-85fa-426d-adfa-3f777d477901 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.158740 Apr 12 15:00:26.757743 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 418/811] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:26 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:27.181520 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-53318913-e2a9-4e1d-a4d1-af9bbbce378f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:27.182312 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-53318913-e2a9-4e1d-a4d1-af9bbbce378f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:27.188723 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53318913-e2a9-4e1d-a4d1-af9bbbce378f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:27.189176 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53318913-e2a9-4e1d-a4d1-af9bbbce378f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:27.190254 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53318913-e2a9-4e1d-a4d1-af9bbbce378f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:27.190447 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53318913-e2a9-4e1d-a4d1-af9bbbce378f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:27.326606 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-53318913-e2a9-4e1d-a4d1-af9bbbce378f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:27.334052 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-53318913-e2a9-4e1d-a4d1-af9bbbce378f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1569 microversion: 2.1 time: 0.156434 Apr 12 15:00:27.334622 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 394/812] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:27 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:27.356971 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cd01e759-67d5-4b08-9954-468cdbee43b5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:27.357539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cd01e759-67d5-4b08-9954-468cdbee43b5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:27.364037 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd01e759-67d5-4b08-9954-468cdbee43b5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:27.364482 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd01e759-67d5-4b08-9954-468cdbee43b5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:27.370311 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd01e759-67d5-4b08-9954-468cdbee43b5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:27.370311 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cd01e759-67d5-4b08-9954-468cdbee43b5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:27.695122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cd01e759-67d5-4b08-9954-468cdbee43b5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [df139b94-5f91-4998-b60f-436f34bdaa9e] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 15:00:27.780478 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4dfae724-4d40-4e9d-9c37-539b0cc41e6d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:27.780744 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4dfae724-4d40-4e9d-9c37-539b0cc41e6d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:27.788179 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4dfae724-4d40-4e9d-9c37-539b0cc41e6d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:27.788730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4dfae724-4d40-4e9d-9c37-539b0cc41e6d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:27.789507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4dfae724-4d40-4e9d-9c37-539b0cc41e6d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:27.789979 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4dfae724-4d40-4e9d-9c37-539b0cc41e6d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:27.930480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4dfae724-4d40-4e9d-9c37-539b0cc41e6d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:27.938217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4dfae724-4d40-4e9d-9c37-539b0cc41e6d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:27.939740 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4dfae724-4d40-4e9d-9c37-539b0cc41e6d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:27.940889 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4dfae724-4d40-4e9d-9c37-539b0cc41e6d tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.169865 Apr 12 15:00:27.942289 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 395/813] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:27 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:28.696022 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [None req-cd01e759-67d5-4b08-9954-468cdbee43b5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [df139b94-5f91-4998-b60f-436f34bdaa9e] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 56350. Apr 12 15:00:28.699891 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cd01e759-67d5-4b08-9954-468cdbee43b5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "POST /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013/action" status: 202 len: 0 microversion: 2.1 time: 1.347168 Apr 12 15:00:28.701181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 419/814] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Apr 12 15:00:27 2022] POST /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013/action => generated 0 bytes in 1349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 15:00:28.710501 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-39a827e6-232c-4595-9f92-20685b4115de tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:28.714764 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-39a827e6-232c-4595-9f92-20685b4115de tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:28.721725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-39a827e6-232c-4595-9f92-20685b4115de tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:28.722725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-39a827e6-232c-4595-9f92-20685b4115de tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:28.724603 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-39a827e6-232c-4595-9f92-20685b4115de tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:28.725201 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-39a827e6-232c-4595-9f92-20685b4115de tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:28.856835 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-39a827e6-232c-4595-9f92-20685b4115de tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:28.864967 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-39a827e6-232c-4595-9f92-20685b4115de tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1517 microversion: 2.1 time: 0.159035 Apr 12 15:00:28.865531 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 396/815] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:28 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:28.960690 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-04f0ff16-b37e-4eb3-ac36-20ec19ff52b3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:28.961446 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-04f0ff16-b37e-4eb3-ac36-20ec19ff52b3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:28.969479 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-04f0ff16-b37e-4eb3-ac36-20ec19ff52b3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:28.969957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-04f0ff16-b37e-4eb3-ac36-20ec19ff52b3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:28.970724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-04f0ff16-b37e-4eb3-ac36-20ec19ff52b3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:28.971149 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-04f0ff16-b37e-4eb3-ac36-20ec19ff52b3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:29.166213 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-04f0ff16-b37e-4eb3-ac36-20ec19ff52b3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:29.174937 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-04f0ff16-b37e-4eb3-ac36-20ec19ff52b3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:29.176462 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-04f0ff16-b37e-4eb3-ac36-20ec19ff52b3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:29.177924 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-04f0ff16-b37e-4eb3-ac36-20ec19ff52b3 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1732 microversion: 2.20 time: 0.221688 Apr 12 15:00:29.178896 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 420/816] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:28 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:29.641512 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-9f686e89-cff2-41dd-889c-e7017ce69ca9 req-9df20e99-91fc-45c3-b7a9-a1f3fbbb0f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e688875-ca8d-4972-9d02-9c66a8634013", "name": "network-vif-unplugged", "status": "completed", "tag": "1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:29.650856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-9f686e89-cff2-41dd-889c-e7017ce69ca9 req-9df20e99-91fc-45c3-b7a9-a1f3fbbb0f30 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:29.651354 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-9f686e89-cff2-41dd-889c-e7017ce69ca9 req-9df20e99-91fc-45c3-b7a9-a1f3fbbb0f30 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:29.662810 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.compute.server_external_events [req-9f686e89-cff2-41dd-889c-e7017ce69ca9 req-9df20e99-91fc-45c3-b7a9-a1f3fbbb0f30 service nova] Unable to find a host for instance 7e688875-ca8d-4972-9d02-9c66a8634013. Dropping event network-vif-unplugged {{(pid=124198) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 12 15:00:29.663680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-9f686e89-cff2-41dd-889c-e7017ce69ca9 req-9df20e99-91fc-45c3-b7a9-a1f3fbbb0f30 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026166 Apr 12 15:00:29.664271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 397/817] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 12 15:00:29.882877 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bd298bf1-5eff-4b69-a3e5-c8a6cb57a0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:29.883593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bd298bf1-5eff-4b69-a3e5-c8a6cb57a0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:29.890187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd298bf1-5eff-4b69-a3e5-c8a6cb57a0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:29.890704 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd298bf1-5eff-4b69-a3e5-c8a6cb57a0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:29.891537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd298bf1-5eff-4b69-a3e5-c8a6cb57a0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:29.892039 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd298bf1-5eff-4b69-a3e5-c8a6cb57a0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:30.032847 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bd298bf1-5eff-4b69-a3e5-c8a6cb57a0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:30.040437 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bd298bf1-5eff-4b69-a3e5-c8a6cb57a0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1517 microversion: 2.1 time: 0.162124 Apr 12 15:00:30.043809 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 421/818] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:29 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:30.197454 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ff96e591-de90-4ad4-8372-445d743ef65b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:30.198090 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ff96e591-de90-4ad4-8372-445d743ef65b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:30.204597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ff96e591-de90-4ad4-8372-445d743ef65b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:30.205042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ff96e591-de90-4ad4-8372-445d743ef65b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:30.205821 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ff96e591-de90-4ad4-8372-445d743ef65b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:30.206251 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ff96e591-de90-4ad4-8372-445d743ef65b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:30.342737 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ff96e591-de90-4ad4-8372-445d743ef65b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:30.352084 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ff96e591-de90-4ad4-8372-445d743ef65b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:30.353579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ff96e591-de90-4ad4-8372-445d743ef65b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:30.365673 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ff96e591-de90-4ad4-8372-445d743ef65b tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1719 microversion: 2.20 time: 0.161727 Apr 12 15:00:30.365673 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 398/819] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:00:30 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:00:31.058006 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ee3ac8f0-2ae2-4e81-9a74-7d8c96c366e6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:31.058571 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ee3ac8f0-2ae2-4e81-9a74-7d8c96c366e6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:31.065796 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee3ac8f0-2ae2-4e81-9a74-7d8c96c366e6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:31.076752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee3ac8f0-2ae2-4e81-9a74-7d8c96c366e6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:31.076752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee3ac8f0-2ae2-4e81-9a74-7d8c96c366e6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:31.076752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee3ac8f0-2ae2-4e81-9a74-7d8c96c366e6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:31.239514 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ee3ac8f0-2ae2-4e81-9a74-7d8c96c366e6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:31.247305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ee3ac8f0-2ae2-4e81-9a74-7d8c96c366e6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1519 microversion: 2.1 time: 0.193336 Apr 12 15:00:31.247881 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 422/820] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:31 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:31.997866 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-12049258-65dd-4834-8a01-3f552dd1b4e7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:31.998420 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-12049258-65dd-4834-8a01-3f552dd1b4e7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:32.005426 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-12049258-65dd-4834-8a01-3f552dd1b4e7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:32.005899 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-12049258-65dd-4834-8a01-3f552dd1b4e7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:32.006690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-12049258-65dd-4834-8a01-3f552dd1b4e7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:32.007114 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-12049258-65dd-4834-8a01-3f552dd1b4e7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:32.091890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-12049258-65dd-4834-8a01-3f552dd1b4e7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lazy-loading 'services' on Instance uuid 54aad714-d9bc-4325-92c4-d0bd27ee9f8e {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 15:00:32.268157 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fd982502-078e-459d-8b2a-6e0b98cd5c27 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:32.268863 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fd982502-078e-459d-8b2a-6e0b98cd5c27 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:32.275479 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd982502-078e-459d-8b2a-6e0b98cd5c27 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:32.275924 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd982502-078e-459d-8b2a-6e0b98cd5c27 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:32.276718 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd982502-078e-459d-8b2a-6e0b98cd5c27 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:32.277152 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fd982502-078e-459d-8b2a-6e0b98cd5c27 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:32.325999 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-12049258-65dd-4834-8a01-3f552dd1b4e7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments/3a92464b-cd4c-41b2-ab4c-eaf48919d9a1" status: 202 len: 0 microversion: 2.1 time: 0.331942 Apr 12 15:00:32.326582 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 399/821] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Apr 12 15:00:31 2022] DELETE /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments/3a92464b-cd4c-41b2-ab4c-eaf48919d9a1 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 15:00:32.335404 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bb0ead3a-0268-4bf2-927f-2cb541f49ab7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:32.336647 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bb0ead3a-0268-4bf2-927f-2cb541f49ab7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:32.348507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bb0ead3a-0268-4bf2-927f-2cb541f49ab7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:32.348507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bb0ead3a-0268-4bf2-927f-2cb541f49ab7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:32.348507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bb0ead3a-0268-4bf2-927f-2cb541f49ab7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:32.348507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bb0ead3a-0268-4bf2-927f-2cb541f49ab7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:32.376072 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bb0ead3a-0268-4bf2-927f-2cb541f49ab7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044971 Apr 12 15:00:32.380584 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 400/822] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 15:00:32 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 15:00:32.414719 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fd982502-078e-459d-8b2a-6e0b98cd5c27 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:32.422281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fd982502-078e-459d-8b2a-6e0b98cd5c27 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1519 microversion: 2.1 time: 0.158025 Apr 12 15:00:32.422844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 423/823] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:32 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:33.389929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-147d6273-c513-4510-9243-72990da3f552 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:33.398501 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-147d6273-c513-4510-9243-72990da3f552 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:33.401246 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-147d6273-c513-4510-9243-72990da3f552 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:33.401906 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-147d6273-c513-4510-9243-72990da3f552 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:33.402804 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-147d6273-c513-4510-9243-72990da3f552 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:33.403383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-147d6273-c513-4510-9243-72990da3f552 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:33.441058 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-147d6273-c513-4510-9243-72990da3f552 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055015 Apr 12 15:00:33.442105 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7081c365-0253-464b-819c-9d084d32b24a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:33.442668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 401/824] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 15:00:33 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:00:33.443487 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7081c365-0253-464b-819c-9d084d32b24a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:33.450832 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7081c365-0253-464b-819c-9d084d32b24a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:33.451280 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7081c365-0253-464b-819c-9d084d32b24a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:33.452049 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7081c365-0253-464b-819c-9d084d32b24a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:33.452484 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7081c365-0253-464b-819c-9d084d32b24a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:33.587969 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7081c365-0253-464b-819c-9d084d32b24a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:33.595492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7081c365-0253-464b-819c-9d084d32b24a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1519 microversion: 2.1 time: 0.157793 Apr 12 15:00:33.596056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 424/825] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:33 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:34.453566 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-94dbc160-2ac8-4ab2-986e-56001b90323c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:34.454506 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-94dbc160-2ac8-4ab2-986e-56001b90323c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:34.461256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94dbc160-2ac8-4ab2-986e-56001b90323c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:34.461743 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94dbc160-2ac8-4ab2-986e-56001b90323c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:34.462516 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94dbc160-2ac8-4ab2-986e-56001b90323c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:34.462954 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-94dbc160-2ac8-4ab2-986e-56001b90323c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:34.492752 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-94dbc160-2ac8-4ab2-986e-56001b90323c tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043065 Apr 12 15:00:34.493313 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 402/826] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 15:00:34 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:00:34.614962 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-690bbbc2-5096-45a7-b902-adb82ed3f3d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:34.615664 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-690bbbc2-5096-45a7-b902-adb82ed3f3d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:34.631029 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-690bbbc2-5096-45a7-b902-adb82ed3f3d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:34.631608 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-690bbbc2-5096-45a7-b902-adb82ed3f3d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:34.632435 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-690bbbc2-5096-45a7-b902-adb82ed3f3d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:34.633222 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-690bbbc2-5096-45a7-b902-adb82ed3f3d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:34.931308 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-690bbbc2-5096-45a7-b902-adb82ed3f3d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:34.939623 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-690bbbc2-5096-45a7-b902-adb82ed3f3d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1519 microversion: 2.1 time: 0.329676 Apr 12 15:00:34.940194 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 425/827] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:34 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1519 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:35.507285 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-93b2476c-28a5-4ff2-983b-25a21f070a62 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:35.508453 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-93b2476c-28a5-4ff2-983b-25a21f070a62 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:35.515278 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-93b2476c-28a5-4ff2-983b-25a21f070a62 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:35.515820 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-93b2476c-28a5-4ff2-983b-25a21f070a62 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:35.516672 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-93b2476c-28a5-4ff2-983b-25a21f070a62 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:35.517163 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-93b2476c-28a5-4ff2-983b-25a21f070a62 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:35.555637 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-93b2476c-28a5-4ff2-983b-25a21f070a62 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054193 Apr 12 15:00:35.556429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 403/828] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Apr 12 15:00:35 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 15:00:35.706028 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1c2e717f-d769-4286-b8d6-8eff1ba8e100 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:35.706602 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1c2e717f-d769-4286-b8d6-8eff1ba8e100 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:35.714769 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c2e717f-d769-4286-b8d6-8eff1ba8e100 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:35.715221 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c2e717f-d769-4286-b8d6-8eff1ba8e100 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:35.716001 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c2e717f-d769-4286-b8d6-8eff1ba8e100 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:35.716435 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c2e717f-d769-4286-b8d6-8eff1ba8e100 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:35.744036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1c2e717f-d769-4286-b8d6-8eff1ba8e100 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 15:00:35.957367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-df67c414-de83-4c1d-868e-8aea6597b983 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:35.958623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-df67c414-de83-4c1d-868e-8aea6597b983 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:35.964724 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df67c414-de83-4c1d-868e-8aea6597b983 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:35.965166 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df67c414-de83-4c1d-868e-8aea6597b983 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:35.966006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df67c414-de83-4c1d-868e-8aea6597b983 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:35.966612 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df67c414-de83-4c1d-868e-8aea6597b983 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:36.105986 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-df67c414-de83-4c1d-868e-8aea6597b983 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:36.114822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-df67c414-de83-4c1d-868e-8aea6597b983 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.161365 Apr 12 15:00:36.115901 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 404/829] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:35 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:36.132376 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1c2e717f-d769-4286-b8d6-8eff1ba8e100 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 204 len: 0 microversion: 2.1 time: 0.430041 Apr 12 15:00:36.132895 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 426/830] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:00:35 2022] DELETE /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 15:00:36.140938 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-abac227d-0a7d-465f-b17c-adca177ac6b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:36.141537 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-abac227d-0a7d-465f-b17c-adca177ac6b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:36.148022 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abac227d-0a7d-465f-b17c-adca177ac6b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:36.148466 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abac227d-0a7d-465f-b17c-adca177ac6b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:36.149230 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abac227d-0a7d-465f-b17c-adca177ac6b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:36.149688 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abac227d-0a7d-465f-b17c-adca177ac6b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:36.282413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-abac227d-0a7d-465f-b17c-adca177ac6b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:36.290688 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-abac227d-0a7d-465f-b17c-adca177ac6b6 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1679 microversion: 2.1 time: 0.153583 Apr 12 15:00:36.291260 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 405/831] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:36 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:37.133462 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-aaf81c9f-8959-4d3d-bd99-bd301a593f53 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:37.134553 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-aaf81c9f-8959-4d3d-bd99-bd301a593f53 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:37.140866 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aaf81c9f-8959-4d3d-bd99-bd301a593f53 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:37.146748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aaf81c9f-8959-4d3d-bd99-bd301a593f53 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:37.146748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aaf81c9f-8959-4d3d-bd99-bd301a593f53 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:37.146748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aaf81c9f-8959-4d3d-bd99-bd301a593f53 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:37.276874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aaf81c9f-8959-4d3d-bd99-bd301a593f53 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:37.284707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-aaf81c9f-8959-4d3d-bd99-bd301a593f53 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.156431 Apr 12 15:00:37.285526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 427/832] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:37 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:37.310036 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a1bc8556-06e8-4822-b88b-52df481675da tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:37.310934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a1bc8556-06e8-4822-b88b-52df481675da tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:37.320914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a1bc8556-06e8-4822-b88b-52df481675da tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:37.321425 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a1bc8556-06e8-4822-b88b-52df481675da tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:37.322214 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a1bc8556-06e8-4822-b88b-52df481675da tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:37.322600 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a1bc8556-06e8-4822-b88b-52df481675da tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:37.465603 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a1bc8556-06e8-4822-b88b-52df481675da tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:37.474290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a1bc8556-06e8-4822-b88b-52df481675da tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1679 microversion: 2.1 time: 0.168797 Apr 12 15:00:37.474889 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 406/833] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:37 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:38.305671 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b25f625c-71fa-4a90-acfe-49983ff2cac0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:38.306550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b25f625c-71fa-4a90-acfe-49983ff2cac0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:38.313919 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b25f625c-71fa-4a90-acfe-49983ff2cac0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:38.314496 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b25f625c-71fa-4a90-acfe-49983ff2cac0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:38.315532 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b25f625c-71fa-4a90-acfe-49983ff2cac0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:38.316078 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b25f625c-71fa-4a90-acfe-49983ff2cac0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:38.456546 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b25f625c-71fa-4a90-acfe-49983ff2cac0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:38.464932 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b25f625c-71fa-4a90-acfe-49983ff2cac0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.165576 Apr 12 15:00:38.465501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 428/834] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:38 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:38.491527 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f27eaa03-4db2-4b54-a861-aa8ce2028db1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:38.492232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f27eaa03-4db2-4b54-a861-aa8ce2028db1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:38.498608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f27eaa03-4db2-4b54-a861-aa8ce2028db1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:38.499129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f27eaa03-4db2-4b54-a861-aa8ce2028db1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:38.500150 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f27eaa03-4db2-4b54-a861-aa8ce2028db1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:38.500636 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f27eaa03-4db2-4b54-a861-aa8ce2028db1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:38.571775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f27eaa03-4db2-4b54-a861-aa8ce2028db1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:38.579795 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f27eaa03-4db2-4b54-a861-aa8ce2028db1 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1612 microversion: 2.1 time: 0.092167 Apr 12 15:00:38.580538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 407/835] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:38 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1612 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:38.866957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-4c006f1a-5a2d-42d9-9960-129a4792492f req-90c6ffa3-3fb6-40e4-99aa-09150549c23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54aad714-d9bc-4325-92c4-d0bd27ee9f8e", "name": "network-vif-deleted", "tag": "38807db4-8d4f-4f2b-a507-82221710ecd9"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:38.878332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-4c006f1a-5a2d-42d9-9960-129a4792492f req-90c6ffa3-3fb6-40e4-99aa-09150549c23d service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:38.879804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-4c006f1a-5a2d-42d9-9960-129a4792492f req-90c6ffa3-3fb6-40e4-99aa-09150549c23d service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:38.897915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-4c006f1a-5a2d-42d9-9960-129a4792492f req-90c6ffa3-3fb6-40e4-99aa-09150549c23d service nova] Creating event network-vif-deleted:38807db4-8d4f-4f2b-a507-82221710ecd9 for instance 54aad714-d9bc-4325-92c4-d0bd27ee9f8e on hv-cinder-83752 Apr 12 15:00:38.905460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-4c006f1a-5a2d-42d9-9960-129a4792492f req-90c6ffa3-3fb6-40e4-99aa-09150549c23d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044214 Apr 12 15:00:38.906545 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 429/836] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:00:39.483979 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3d727d98-e30d-4cab-9209-aeb4a4f2addb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:39.484772 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3d727d98-e30d-4cab-9209-aeb4a4f2addb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:39.493541 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d727d98-e30d-4cab-9209-aeb4a4f2addb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:39.494652 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d727d98-e30d-4cab-9209-aeb4a4f2addb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:39.496109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d727d98-e30d-4cab-9209-aeb4a4f2addb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:39.496714 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d727d98-e30d-4cab-9209-aeb4a4f2addb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:39.598513 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:39.599571 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:39.606371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:39.606829 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:39.607591 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:39.608244 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:39.643500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:39.643950 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:39.644897 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lazy-loading 'fault' on Instance uuid 54aad714-d9bc-4325-92c4-d0bd27ee9f8e {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 15:00:39.655801 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3d727d98-e30d-4cab-9209-aeb4a4f2addb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:39.666196 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3d727d98-e30d-4cab-9209-aeb4a4f2addb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.186763 Apr 12 15:00:39.667757 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 408/837] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:39 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:39.688306 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ff63c087484d2db34665eb0ecc8430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b1cfd6536e4795874488a31e0d41d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:39.697299 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d9a01af5-eda4-4920-bb37-2aebcc3df99f tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 200 len: 1330 microversion: 2.1 time: 0.103057 Apr 12 15:00:39.707101 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 430/838] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:39 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 1330 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:40.685745 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-af978175-36d4-4feb-94c0-91fbfef5acf3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:40.686346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-af978175-36d4-4feb-94c0-91fbfef5acf3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:40.693132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-af978175-36d4-4feb-94c0-91fbfef5acf3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:40.693591 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-af978175-36d4-4feb-94c0-91fbfef5acf3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:40.694402 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-af978175-36d4-4feb-94c0-91fbfef5acf3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:40.695107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-af978175-36d4-4feb-94c0-91fbfef5acf3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:40.718736 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77f46cd9-17fa-45d3-b7c2-cd9d257703ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:40.720253 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-77f46cd9-17fa-45d3-b7c2-cd9d257703ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:40.728352 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77f46cd9-17fa-45d3-b7c2-cd9d257703ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:40.729156 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77f46cd9-17fa-45d3-b7c2-cd9d257703ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:40.732858 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77f46cd9-17fa-45d3-b7c2-cd9d257703ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:40.732858 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77f46cd9-17fa-45d3-b7c2-cd9d257703ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:40.748645 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-77f46cd9-17fa-45d3-b7c2-cd9d257703ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance 54aad714-d9bc-4325-92c4-d0bd27ee9f8e could not be found. Apr 12 15:00:40.749195 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77f46cd9-17fa-45d3-b7c2-cd9d257703ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance 54aad714-d9bc-4325-92c4-d0bd27ee9f8e could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:40.750254 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-77f46cd9-17fa-45d3-b7c2-cd9d257703ae tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 404 len: 111 microversion: 2.1 time: 0.037001 Apr 12 15:00:40.750798 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 431/839] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:40 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:00:40.759809 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6796b4b3-40d2-42fe-a0ef-86f346c97742 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '.version_select at 0x7fbd608ff0d0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:40.836450 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-af978175-36d4-4feb-94c0-91fbfef5acf3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:40.844474 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-af978175-36d4-4feb-94c0-91fbfef5acf3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.162587 Apr 12 15:00:40.847595 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 409/840] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:40 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:40.911039 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6796b4b3-40d2-42fe-a0ef-86f346c97742 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54207108" status: 202 len: 0 microversion: 2.1 time: 0.154131 Apr 12 15:00:40.911039 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 432/841] 10.222.0.64 () {58 vars in 1214 bytes} [Tue Apr 12 15:00:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54207108 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 15:00:41.862750 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-643eb90c-bc74-4924-9671-9d9a74eed2f5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:41.863610 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-643eb90c-bc74-4924-9671-9d9a74eed2f5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:41.871437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-643eb90c-bc74-4924-9671-9d9a74eed2f5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:41.872080 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-643eb90c-bc74-4924-9671-9d9a74eed2f5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:41.872850 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-643eb90c-bc74-4924-9671-9d9a74eed2f5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:41.873358 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-643eb90c-bc74-4924-9671-9d9a74eed2f5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:42.018726 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-643eb90c-bc74-4924-9671-9d9a74eed2f5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:42.027732 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-643eb90c-bc74-4924-9671-9d9a74eed2f5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.169466 Apr 12 15:00:42.028271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 410/842] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:41 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:43.047147 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-349ac0b0-4c85-4e30-96da-28889611b154 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:43.047780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-349ac0b0-4c85-4e30-96da-28889611b154 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:43.057138 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-349ac0b0-4c85-4e30-96da-28889611b154 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:43.057578 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-349ac0b0-4c85-4e30-96da-28889611b154 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:43.058660 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-349ac0b0-4c85-4e30-96da-28889611b154 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:43.059508 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-349ac0b0-4c85-4e30-96da-28889611b154 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:43.092864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2e8d78fa-c98e-4487-977b-cd75ee8942d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:43.093771 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2e8d78fa-c98e-4487-977b-cd75ee8942d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:43.100924 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e8d78fa-c98e-4487-977b-cd75ee8942d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:43.101368 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e8d78fa-c98e-4487-977b-cd75ee8942d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:43.102164 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e8d78fa-c98e-4487-977b-cd75ee8942d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:43.102595 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e8d78fa-c98e-4487-977b-cd75ee8942d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:43.123632 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-2e8d78fa-c98e-4487-977b-cd75ee8942d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance 54aad714-d9bc-4325-92c4-d0bd27ee9f8e could not be found. Apr 12 15:00:43.124229 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2e8d78fa-c98e-4487-977b-cd75ee8942d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance 54aad714-d9bc-4325-92c4-d0bd27ee9f8e could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:43.125045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2e8d78fa-c98e-4487-977b-cd75ee8942d0 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 404 len: 111 microversion: 2.1 time: 0.037657 Apr 12 15:00:43.128623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 411/843] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:00:43 2022] DELETE /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 15:00:43.133822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-91ebc8b5-5874-4f68-abed-f16817c1e2f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:43.134413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-91ebc8b5-5874-4f68-abed-f16817c1e2f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: 54aad714-d9bc-4325-92c4-d0bd27ee9f8e] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:43.140950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91ebc8b5-5874-4f68-abed-f16817c1e2f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:43.141400 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91ebc8b5-5874-4f68-abed-f16817c1e2f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:43.142196 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91ebc8b5-5874-4f68-abed-f16817c1e2f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:43.142640 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91ebc8b5-5874-4f68-abed-f16817c1e2f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:43.169792 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-91ebc8b5-5874-4f68-abed-f16817c1e2f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance 54aad714-d9bc-4325-92c4-d0bd27ee9f8e could not be found. Apr 12 15:00:43.174602 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-91ebc8b5-5874-4f68-abed-f16817c1e2f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance 54aad714-d9bc-4325-92c4-d0bd27ee9f8e could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:43.174602 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-91ebc8b5-5874-4f68-abed-f16817c1e2f7 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e" status: 404 len: 111 microversion: 2.1 time: 0.041809 Apr 12 15:00:43.184949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 412/844] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:43 2022] GET /compute/v2.1/servers/54aad714-d9bc-4325-92c4-d0bd27ee9f8e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:00:43.224034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-349ac0b0-4c85-4e30-96da-28889611b154 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:43.231781 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-349ac0b0-4c85-4e30-96da-28889611b154 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.188869 Apr 12 15:00:43.232513 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 433/845] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:43 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:44.256987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d5d01729-2f86-4d04-a5b4-b523899dbe2d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:44.260226 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d5d01729-2f86-4d04-a5b4-b523899dbe2d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:44.273153 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5d01729-2f86-4d04-a5b4-b523899dbe2d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:44.273610 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5d01729-2f86-4d04-a5b4-b523899dbe2d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:44.274423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5d01729-2f86-4d04-a5b4-b523899dbe2d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:44.274865 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5d01729-2f86-4d04-a5b4-b523899dbe2d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:44.443951 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d5d01729-2f86-4d04-a5b4-b523899dbe2d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:44.453143 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d5d01729-2f86-4d04-a5b4-b523899dbe2d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.207063 Apr 12 15:00:44.457352 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 413/846] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:44 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:44.469388 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-619700db-304b-413d-9292-6ed741be6d01 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:44.469933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-619700db-304b-413d-9292-6ed741be6d01 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:44.478541 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-619700db-304b-413d-9292-6ed741be6d01 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:44.479449 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-619700db-304b-413d-9292-6ed741be6d01 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:44.480648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-619700db-304b-413d-9292-6ed741be6d01 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:44.481309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-619700db-304b-413d-9292-6ed741be6d01 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:44.502273 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-619700db-304b-413d-9292-6ed741be6d01 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance ae131a2b-c453-4c6c-b640-61daffe8c005 could not be found. Apr 12 15:00:44.503159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-619700db-304b-413d-9292-6ed741be6d01 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance ae131a2b-c453-4c6c-b640-61daffe8c005 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:44.505207 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-619700db-304b-413d-9292-6ed741be6d01 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 404 len: 111 microversion: 2.1 time: 0.039878 Apr 12 15:00:44.506256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 434/847] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:00:44 2022] DELETE /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:00:44.514477 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-de36d35f-1fb8-43fe-83d2-0290d8306ceb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:44.515183 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-de36d35f-1fb8-43fe-83d2-0290d8306ceb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: ae131a2b-c453-4c6c-b640-61daffe8c005] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:44.525070 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de36d35f-1fb8-43fe-83d2-0290d8306ceb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:44.529824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de36d35f-1fb8-43fe-83d2-0290d8306ceb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:44.529824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de36d35f-1fb8-43fe-83d2-0290d8306ceb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:44.529824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de36d35f-1fb8-43fe-83d2-0290d8306ceb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:44.543285 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-de36d35f-1fb8-43fe-83d2-0290d8306ceb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance ae131a2b-c453-4c6c-b640-61daffe8c005 could not be found. Apr 12 15:00:44.543937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-de36d35f-1fb8-43fe-83d2-0290d8306ceb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance ae131a2b-c453-4c6c-b640-61daffe8c005 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:44.545036 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-de36d35f-1fb8-43fe-83d2-0290d8306ceb tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005" status: 404 len: 111 microversion: 2.1 time: 0.034330 Apr 12 15:00:44.545928 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 414/848] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:44 2022] GET /compute/v2.1/servers/ae131a2b-c453-4c6c-b640-61daffe8c005 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:00:44.555416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-900c0aaa-df2a-450e-96a9-6814c17ac2cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:44.556143 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-900c0aaa-df2a-450e-96a9-6814c17ac2cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:44.563062 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-900c0aaa-df2a-450e-96a9-6814c17ac2cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:44.563703 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-900c0aaa-df2a-450e-96a9-6814c17ac2cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:44.564694 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-900c0aaa-df2a-450e-96a9-6814c17ac2cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:44.565136 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-900c0aaa-df2a-450e-96a9-6814c17ac2cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:44.580100 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-900c0aaa-df2a-450e-96a9-6814c17ac2cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance a709c0e8-54c5-43a2-a065-4ee9445449c9 could not be found. Apr 12 15:00:44.580746 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-900c0aaa-df2a-450e-96a9-6814c17ac2cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance a709c0e8-54c5-43a2-a065-4ee9445449c9 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:44.581874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-900c0aaa-df2a-450e-96a9-6814c17ac2cd tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 404 len: 111 microversion: 2.1 time: 0.031733 Apr 12 15:00:44.582260 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 435/849] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:00:44 2022] DELETE /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:00:44.590325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1bac1bdf-5123-4092-8914-9af767aad2e5 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:44.590931 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1bac1bdf-5123-4092-8914-9af767aad2e5 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: a709c0e8-54c5-43a2-a065-4ee9445449c9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:44.596845 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1bac1bdf-5123-4092-8914-9af767aad2e5 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:44.598031 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1bac1bdf-5123-4092-8914-9af767aad2e5 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:44.598950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1bac1bdf-5123-4092-8914-9af767aad2e5 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:44.599384 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1bac1bdf-5123-4092-8914-9af767aad2e5 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:44.612311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-1bac1bdf-5123-4092-8914-9af767aad2e5 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance a709c0e8-54c5-43a2-a065-4ee9445449c9 could not be found. Apr 12 15:00:44.613523 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1bac1bdf-5123-4092-8914-9af767aad2e5 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance a709c0e8-54c5-43a2-a065-4ee9445449c9 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:44.614533 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1bac1bdf-5123-4092-8914-9af767aad2e5 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9" status: 404 len: 111 microversion: 2.1 time: 0.027997 Apr 12 15:00:44.615048 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 415/850] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:44 2022] GET /compute/v2.1/servers/a709c0e8-54c5-43a2-a065-4ee9445449c9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:00:45.472110 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e712d76b-ab89-4d5c-b7bd-f25e88cdd034 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:45.472813 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e712d76b-ab89-4d5c-b7bd-f25e88cdd034 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:45.479220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e712d76b-ab89-4d5c-b7bd-f25e88cdd034 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:45.479668 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e712d76b-ab89-4d5c-b7bd-f25e88cdd034 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:45.480442 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e712d76b-ab89-4d5c-b7bd-f25e88cdd034 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:45.480876 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e712d76b-ab89-4d5c-b7bd-f25e88cdd034 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:45.616177 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e712d76b-ab89-4d5c-b7bd-f25e88cdd034 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:45.623475 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e712d76b-ab89-4d5c-b7bd-f25e88cdd034 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.155277 Apr 12 15:00:45.624240 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 436/851] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:45 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:00:46.641943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1a25f541-0956-4c4a-be03-dc9d3596ac7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:46.642456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1a25f541-0956-4c4a-be03-dc9d3596ac7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:46.648795 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a25f541-0956-4c4a-be03-dc9d3596ac7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:46.649239 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a25f541-0956-4c4a-be03-dc9d3596ac7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:46.650043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a25f541-0956-4c4a-be03-dc9d3596ac7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:46.664192 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a25f541-0956-4c4a-be03-dc9d3596ac7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:46.786937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1a25f541-0956-4c4a-be03-dc9d3596ac7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:46.794563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1a25f541-0956-4c4a-be03-dc9d3596ac7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.156534 Apr 12 15:00:46.795125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 416/852] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:46 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:47.321137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-6677893f-a198-41da-9ea6-0bf0271de803 req-a66c25cf-5727-4f8c-8bc0-0a4fe6463068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e688875-ca8d-4972-9d02-9c66a8634013", "name": "network-vif-plugged", "status": "completed", "tag": "1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:00:47.329412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6677893f-a198-41da-9ea6-0bf0271de803 req-a66c25cf-5727-4f8c-8bc0-0a4fe6463068 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:47.329893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-6677893f-a198-41da-9ea6-0bf0271de803 req-a66c25cf-5727-4f8c-8bc0-0a4fe6463068 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:47.341767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-6677893f-a198-41da-9ea6-0bf0271de803 req-a66c25cf-5727-4f8c-8bc0-0a4fe6463068 service nova] Creating event network-vif-plugged:1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe for instance 7e688875-ca8d-4972-9d02-9c66a8634013 on hv-cinder-83752 Apr 12 15:00:47.346606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-6677893f-a198-41da-9ea6-0bf0271de803 req-a66c25cf-5727-4f8c-8bc0-0a4fe6463068 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029316 Apr 12 15:00:47.347954 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 437/853] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 15:00:47.812035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-900f7db8-ccbc-4639-83bf-260a6c95b3af tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:47.812644 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-900f7db8-ccbc-4639-83bf-260a6c95b3af tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:47.821443 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-900f7db8-ccbc-4639-83bf-260a6c95b3af tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:47.821918 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-900f7db8-ccbc-4639-83bf-260a6c95b3af tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:47.822691 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-900f7db8-ccbc-4639-83bf-260a6c95b3af tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:47.823126 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-900f7db8-ccbc-4639-83bf-260a6c95b3af tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:47.954448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-900f7db8-ccbc-4639-83bf-260a6c95b3af tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:47.963171 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-900f7db8-ccbc-4639-83bf-260a6c95b3af tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.154922 Apr 12 15:00:47.963730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 417/854] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:47 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:48.004563 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2b0a6344-05ef-42a7-b871-09a55df83b8e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:48.005268 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2b0a6344-05ef-42a7-b871-09a55df83b8e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:48.011859 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b0a6344-05ef-42a7-b871-09a55df83b8e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:48.012425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b0a6344-05ef-42a7-b871-09a55df83b8e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:48.013316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b0a6344-05ef-42a7-b871-09a55df83b8e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:48.013893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b0a6344-05ef-42a7-b871-09a55df83b8e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:48.029830 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-2b0a6344-05ef-42a7-b871-09a55df83b8e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance e2e10895-454d-437b-9325-591ccaa80da9 could not be found. Apr 12 15:00:48.030491 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2b0a6344-05ef-42a7-b871-09a55df83b8e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance e2e10895-454d-437b-9325-591ccaa80da9 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:48.031381 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2b0a6344-05ef-42a7-b871-09a55df83b8e tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 404 len: 111 microversion: 2.1 time: 0.031722 Apr 12 15:00:48.032001 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 438/855] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:00:47 2022] DELETE /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:00:48.044754 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9c3bc932-1067-4001-b833-4de60e711365 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:48.045356 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9c3bc932-1067-4001-b833-4de60e711365 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] [instance: e2e10895-454d-437b-9325-591ccaa80da9] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:48.051516 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c3bc932-1067-4001-b833-4de60e711365 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:48.051959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c3bc932-1067-4001-b833-4de60e711365 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:48.052714 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c3bc932-1067-4001-b833-4de60e711365 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:48.053141 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c3bc932-1067-4001-b833-4de60e711365 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:48.066538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-9c3bc932-1067-4001-b833-4de60e711365 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] HTTP exception thrown: Instance e2e10895-454d-437b-9325-591ccaa80da9 could not be found. Apr 12 15:00:48.067122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9c3bc932-1067-4001-b833-4de60e711365 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] Returning 404 to user: Instance e2e10895-454d-437b-9325-591ccaa80da9 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:00:48.067917 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9c3bc932-1067-4001-b833-4de60e711365 tempest-AttachVolumeNegativeTest-1153643281 tempest-AttachVolumeNegativeTest-1153643281-project] 10.222.0.64 "GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9" status: 404 len: 111 microversion: 2.1 time: 0.027086 Apr 12 15:00:48.068741 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 418/856] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:48 2022] GET /compute/v2.1/servers/e2e10895-454d-437b-9325-591ccaa80da9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:00:48.981335 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5a9ff433-d83e-4891-b14d-0de39dc7b4ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:48.981962 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5a9ff433-d83e-4891-b14d-0de39dc7b4ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:48.990385 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5a9ff433-d83e-4891-b14d-0de39dc7b4ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:48.990812 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5a9ff433-d83e-4891-b14d-0de39dc7b4ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:48.994899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5a9ff433-d83e-4891-b14d-0de39dc7b4ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:48.994899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5a9ff433-d83e-4891-b14d-0de39dc7b4ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:49.134332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5a9ff433-d83e-4891-b14d-0de39dc7b4ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:49.141826 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5a9ff433-d83e-4891-b14d-0de39dc7b4ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1575 microversion: 2.1 time: 0.164403 Apr 12 15:00:49.142464 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 439/857] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:48 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:00:50.159122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-95c52a0e-1690-4cb6-a1aa-80cf1b02acea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:00:50.160763 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-95c52a0e-1690-4cb6-a1aa-80cf1b02acea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:00:50.168866 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95c52a0e-1690-4cb6-a1aa-80cf1b02acea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:50.169491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95c52a0e-1690-4cb6-a1aa-80cf1b02acea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:50.170620 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95c52a0e-1690-4cb6-a1aa-80cf1b02acea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:00:50.171051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95c52a0e-1690-4cb6-a1aa-80cf1b02acea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:00:50.311328 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-95c52a0e-1690-4cb6-a1aa-80cf1b02acea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:00:50.320138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-95c52a0e-1690-4cb6-a1aa-80cf1b02acea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1562 microversion: 2.1 time: 0.164741 Apr 12 15:00:50.331924 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 419/858] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:00:50 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:03.887112 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-131bd673-80ca-4ff8-8c51-352e3aac0d77 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:03.888041 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-131bd673-80ca-4ff8-8c51-352e3aac0d77 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:03.894734 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-131bd673-80ca-4ff8-8c51-352e3aac0d77 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:03.895185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-131bd673-80ca-4ff8-8c51-352e3aac0d77 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:03.895969 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-131bd673-80ca-4ff8-8c51-352e3aac0d77 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:03.896413 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-131bd673-80ca-4ff8-8c51-352e3aac0d77 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:03.927564 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-131bd673-80ca-4ff8-8c51-352e3aac0d77 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044439 Apr 12 15:01:03.928037 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 440/859] 10.222.0.64 () {60 vars in 1342 bytes} [Tue Apr 12 15:01:03 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:03.995946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-747059ea-a402-4ea3-89a5-329ecc942da2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:03.997067 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-747059ea-a402-4ea3-89a5-329ecc942da2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:04.004553 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-747059ea-a402-4ea3-89a5-329ecc942da2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:04.005241 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-747059ea-a402-4ea3-89a5-329ecc942da2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:04.006414 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-747059ea-a402-4ea3-89a5-329ecc942da2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:04.006829 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-747059ea-a402-4ea3-89a5-329ecc942da2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:04.035323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-747059ea-a402-4ea3-89a5-329ecc942da2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 15:01:04.302029 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-747059ea-a402-4ea3-89a5-329ecc942da2 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "DELETE /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 204 len: 0 microversion: 2.20 time: 0.312318 Apr 12 15:01:04.302666 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 420/860] 10.222.0.64 () {60 vars in 1279 bytes} [Tue Apr 12 15:01:03 2022] DELETE /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 15:01:04.311173 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d718b9ef-8547-4a85-9074-7e2c27c630e8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:04.312052 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d718b9ef-8547-4a85-9074-7e2c27c630e8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:04.320480 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d718b9ef-8547-4a85-9074-7e2c27c630e8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:04.321050 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d718b9ef-8547-4a85-9074-7e2c27c630e8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:04.321861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d718b9ef-8547-4a85-9074-7e2c27c630e8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:04.322291 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d718b9ef-8547-4a85-9074-7e2c27c630e8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:04.479183 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d718b9ef-8547-4a85-9074-7e2c27c630e8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:04.488506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d718b9ef-8547-4a85-9074-7e2c27c630e8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:04.490127 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d718b9ef-8547-4a85-9074-7e2c27c630e8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:04.491291 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d718b9ef-8547-4a85-9074-7e2c27c630e8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.184177 Apr 12 15:01:04.493769 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 441/861] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:01:04 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:01:05.513009 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c99d23f8-4e99-4536-9316-48462710510c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:05.513905 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c99d23f8-4e99-4536-9316-48462710510c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:05.521383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c99d23f8-4e99-4536-9316-48462710510c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:05.521964 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c99d23f8-4e99-4536-9316-48462710510c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:05.522780 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c99d23f8-4e99-4536-9316-48462710510c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:05.523279 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c99d23f8-4e99-4536-9316-48462710510c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:05.664744 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c99d23f8-4e99-4536-9316-48462710510c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:05.672786 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c99d23f8-4e99-4536-9316-48462710510c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:05.674319 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c99d23f8-4e99-4536-9316-48462710510c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:05.675605 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c99d23f8-4e99-4536-9316-48462710510c tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1725 microversion: 2.20 time: 0.166959 Apr 12 15:01:05.676174 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 421/862] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:01:05 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:01:06.695485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-00bc4fa2-77d9-4a9d-ab31-61fdb37ba621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:06.696175 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-00bc4fa2-77d9-4a9d-ab31-61fdb37ba621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:06.703231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-00bc4fa2-77d9-4a9d-ab31-61fdb37ba621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:06.703750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-00bc4fa2-77d9-4a9d-ab31-61fdb37ba621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:06.704940 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-00bc4fa2-77d9-4a9d-ab31-61fdb37ba621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:06.705533 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-00bc4fa2-77d9-4a9d-ab31-61fdb37ba621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:06.797277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-00bc4fa2-77d9-4a9d-ab31-61fdb37ba621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:06.806377 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-00bc4fa2-77d9-4a9d-ab31-61fdb37ba621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:06.807918 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-00bc4fa2-77d9-4a9d-ab31-61fdb37ba621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:06.809263 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-00bc4fa2-77d9-4a9d-ab31-61fdb37ba621 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1657 microversion: 2.20 time: 0.118353 Apr 12 15:01:06.809841 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 442/863] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:01:06 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1657 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:01:07.060559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-b9ccbd1c-02c8-4705-a896-04e86ed1ac2e req-d7a755b3-7ce1-40a3-b062-5f231c22a021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946d8ea7-5cb9-4e2f-99b4-27f342c44b63", "name": "network-vif-deleted", "tag": "5c58da46-e5bb-4b4a-8051-745b00e75ae2"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:07.075641 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-b9ccbd1c-02c8-4705-a896-04e86ed1ac2e req-d7a755b3-7ce1-40a3-b062-5f231c22a021 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:07.076602 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-b9ccbd1c-02c8-4705-a896-04e86ed1ac2e req-d7a755b3-7ce1-40a3-b062-5f231c22a021 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:07.099006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-b9ccbd1c-02c8-4705-a896-04e86ed1ac2e req-d7a755b3-7ce1-40a3-b062-5f231c22a021 service nova] Creating event network-vif-deleted:5c58da46-e5bb-4b4a-8051-745b00e75ae2 for instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 on hv-cinder-83752 Apr 12 15:01:07.105998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-b9ccbd1c-02c8-4705-a896-04e86ed1ac2e req-d7a755b3-7ce1-40a3-b062-5f231c22a021 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048764 Apr 12 15:01:07.107727 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 422/864] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:01:07.828321 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:07.828917 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:07.836722 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:07.837166 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:07.837956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:07.838388 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:07.873225 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:07.873779 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:07.874426 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lazy-loading 'fault' on Instance uuid 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 15:01:07.932278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:07.941773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:07.943531 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1719e64e58b14e63b4f2738410cf114f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c2a576e2be74418bdef57686bad30a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:07.945061 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-80c3d846-a164-4be2-916d-51c2bf1e3e25 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 200 len: 1372 microversion: 2.20 time: 0.120579 Apr 12 15:01:07.945621 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 443/865] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:01:07 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:01:08.963533 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-98b344e9-7de1-46ae-9c11-c4eef8985928 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:08.964219 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-98b344e9-7de1-46ae-9c11-c4eef8985928 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:08.972737 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-98b344e9-7de1-46ae-9c11-c4eef8985928 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:08.973237 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-98b344e9-7de1-46ae-9c11-c4eef8985928 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:08.974125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-98b344e9-7de1-46ae-9c11-c4eef8985928 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:08.974560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-98b344e9-7de1-46ae-9c11-c4eef8985928 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:08.988896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-98b344e9-7de1-46ae-9c11-c4eef8985928 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] HTTP exception thrown: Instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 could not be found. Apr 12 15:01:08.989482 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-98b344e9-7de1-46ae-9c11-c4eef8985928 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Returning 404 to user: Instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:01:08.990382 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-98b344e9-7de1-46ae-9c11-c4eef8985928 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 404 len: 111 microversion: 2.20 time: 0.031093 Apr 12 15:01:08.990930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 423/866] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:01:08 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 15:01:09.000247 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4fe416d4-d975-41e1-a118-297d505aa614 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '.version_select at 0x7fbd608f0160>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:09.080081 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4fe416d4-d975-41e1-a118-297d505aa614 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082056460" status: 204 len: 0 microversion: 2.20 time: 0.084380 Apr 12 15:01:09.081485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 444/867] 10.222.0.64 () {60 vars in 1261 bytes} [Tue Apr 12 15:01:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082056460 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 12 15:01:11.090204 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7b8b6772-7a94-4389-bca7-23114a322410 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:11.090727 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7b8b6772-7a94-4389-bca7-23114a322410 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:11.097023 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b8b6772-7a94-4389-bca7-23114a322410 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:11.097726 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b8b6772-7a94-4389-bca7-23114a322410 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:11.098561 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b8b6772-7a94-4389-bca7-23114a322410 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:11.099005 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b8b6772-7a94-4389-bca7-23114a322410 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:11.117762 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-7b8b6772-7a94-4389-bca7-23114a322410 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] HTTP exception thrown: Instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 could not be found. Apr 12 15:01:11.118364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7b8b6772-7a94-4389-bca7-23114a322410 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Returning 404 to user: Instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:01:11.119193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7b8b6772-7a94-4389-bca7-23114a322410 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "DELETE /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 404 len: 111 microversion: 2.20 time: 0.033031 Apr 12 15:01:11.119753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 424/868] 10.222.0.64 () {60 vars in 1279 bytes} [Tue Apr 12 15:01:11 2022] DELETE /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 15:01:11.128480 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-71b662e5-060e-4c53-9c31-0e52262dcdd8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:11.130689 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-71b662e5-060e-4c53-9c31-0e52262dcdd8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 946d8ea7-5cb9-4e2f-99b4-27f342c44b63] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:11.137277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71b662e5-060e-4c53-9c31-0e52262dcdd8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:11.137822 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71b662e5-060e-4c53-9c31-0e52262dcdd8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:11.138598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71b662e5-060e-4c53-9c31-0e52262dcdd8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:11.139030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71b662e5-060e-4c53-9c31-0e52262dcdd8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:11.155324 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-71b662e5-060e-4c53-9c31-0e52262dcdd8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] HTTP exception thrown: Instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 could not be found. Apr 12 15:01:11.155918 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-71b662e5-060e-4c53-9c31-0e52262dcdd8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Returning 404 to user: Instance 946d8ea7-5cb9-4e2f-99b4-27f342c44b63 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:01:11.156743 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-71b662e5-060e-4c53-9c31-0e52262dcdd8 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63" status: 404 len: 111 microversion: 2.20 time: 0.032700 Apr 12 15:01:11.157287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 445/869] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:01:11 2022] GET /compute/v2.1/servers/946d8ea7-5cb9-4e2f-99b4-27f342c44b63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 15:01:12.512786 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b33ec5c8-a724-4880-b226-dd354fc44e02 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:12.513382 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b33ec5c8-a724-4880-b226-dd354fc44e02 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:12.520334 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b33ec5c8-a724-4880-b226-dd354fc44e02 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:12.520794 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b33ec5c8-a724-4880-b226-dd354fc44e02 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:12.521590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b33ec5c8-a724-4880-b226-dd354fc44e02 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:12.522153 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b33ec5c8-a724-4880-b226-dd354fc44e02 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:12.540636 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-b33ec5c8-a724-4880-b226-dd354fc44e02 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] HTTP exception thrown: Instance 9d03f42e-2d51-459d-ade0-7e6a34283867 could not be found. Apr 12 15:01:12.541256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b33ec5c8-a724-4880-b226-dd354fc44e02 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Returning 404 to user: Instance 9d03f42e-2d51-459d-ade0-7e6a34283867 could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:01:12.542115 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b33ec5c8-a724-4880-b226-dd354fc44e02 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 404 len: 111 microversion: 2.20 time: 0.033298 Apr 12 15:01:12.545899 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 425/870] 10.222.0.64 () {60 vars in 1279 bytes} [Tue Apr 12 15:01:12 2022] DELETE /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 15:01:12.551884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-13ca4fb4-257a-42e7-93a4-0c25ad11c031 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:12.552581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-13ca4fb4-257a-42e7-93a4-0c25ad11c031 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] [instance: 9d03f42e-2d51-459d-ade0-7e6a34283867] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:12.559025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-13ca4fb4-257a-42e7-93a4-0c25ad11c031 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:12.559542 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-13ca4fb4-257a-42e7-93a4-0c25ad11c031 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:12.560452 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-13ca4fb4-257a-42e7-93a4-0c25ad11c031 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:12.560891 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-13ca4fb4-257a-42e7-93a4-0c25ad11c031 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:12.574769 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-13ca4fb4-257a-42e7-93a4-0c25ad11c031 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] HTTP exception thrown: Instance 9d03f42e-2d51-459d-ade0-7e6a34283867 could not be found. Apr 12 15:01:12.575378 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-13ca4fb4-257a-42e7-93a4-0c25ad11c031 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] Returning 404 to user: Instance 9d03f42e-2d51-459d-ade0-7e6a34283867 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:01:12.576190 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-13ca4fb4-257a-42e7-93a4-0c25ad11c031 tempest-AttachVolumeShelveTestJSON-1944384063 tempest-AttachVolumeShelveTestJSON-1944384063-project] 10.222.0.64 "GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867" status: 404 len: 111 microversion: 2.20 time: 0.029081 Apr 12 15:01:12.576721 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 446/871] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Apr 12 15:01:12 2022] GET /compute/v2.1/servers/9d03f42e-2d51-459d-ade0-7e6a34283867 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 12 15:01:26.634632 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-880692187", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "networks": [{"uuid": "e057c56c-da75-44fd-9833-db52affcb73c"}]}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:26.695010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] validate_networks() for [('e057c56c-da75-44fd-9833-db52affcb73c', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 15:01:27.663042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:01:27.663611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:01:27.663933 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:01:27.664782 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:01:27.665448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:01:27.674747 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:27.675204 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:27.676299 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:27.676963 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:27.695574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Getting quotas for project 6ca047ef87324b72abe1a98bc09e9d34. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:01:27.699654 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Getting quotas for user a9f5e7c5f43244c482021ab669b4d67f and project 6ca047ef87324b72abe1a98bc09e9d34. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:01:27.711907 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 15:01:27.714202 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 15:01:27.864082 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bd686bf1-4359-4b21-8b69-8adb88f31687 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.233181 Apr 12 15:01:27.869781 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 426/872] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 15:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 15:01:27.878568 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-759bacdb-4ce7-499e-ab18-75b41aa7882b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:27.879867 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-759bacdb-4ce7-499e-ab18-75b41aa7882b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:27.927939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1454884209", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "networks": [{"uuid": "436b3836-e572-4a0a-984f-a83cba21781e"}]}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:27.952152 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-759bacdb-4ce7-499e-ab18-75b41aa7882b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:27.959599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-759bacdb-4ce7-499e-ab18-75b41aa7882b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1213 microversion: 2.1 time: 0.084730 Apr 12 15:01:27.961081 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 447/873] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:27 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:27.998192 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] validate_networks() for [('436b3836-e572-4a0a-984f-a83cba21781e', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 15:01:28.384058 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:01:28.384452 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:01:28.384917 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:01:28.385323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:01:28.385858 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:01:28.394740 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:28.395335 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:28.396390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:28.396861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:28.414208 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Getting quotas for project d534a0fcf985433abc053d9e9543281f. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:01:28.418122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Getting quotas for user 23f5de43637247db911592127a48ff53 and project d534a0fcf985433abc053d9e9543281f. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:01:28.430794 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 15:01:28.442646 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 15:01:28.588890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ec0d172d-655b-43fc-a62c-9d1ad75f65cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666120 Apr 12 15:01:28.594409 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 427/874] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 15:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 12 15:01:28.600537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6a1cc9e9-27db-4226-a0d3-d13057d052c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:28.601283 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6a1cc9e9-27db-4226-a0d3-d13057d052c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:28.682530 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6a1cc9e9-27db-4226-a0d3-d13057d052c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:28.690385 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6a1cc9e9-27db-4226-a0d3-d13057d052c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1219 microversion: 2.1 time: 0.094355 Apr 12 15:01:28.690939 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 448/875] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:28 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:01:28.979583 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-170fc15b-334e-40fd-805a-a2ee766a8a96 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:28.980186 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-170fc15b-334e-40fd-805a-a2ee766a8a96 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:29.033873 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-170fc15b-334e-40fd-805a-a2ee766a8a96 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:29.041255 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-170fc15b-334e-40fd-805a-a2ee766a8a96 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1213 microversion: 2.1 time: 0.066068 Apr 12 15:01:29.041848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 428/876] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:28 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:01:29.708366 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0193c461-9d4c-4bb6-a1fd-ea7e6e23f799 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:29.708975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0193c461-9d4c-4bb6-a1fd-ea7e6e23f799 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:29.763756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0193c461-9d4c-4bb6-a1fd-ea7e6e23f799 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:29.771328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0193c461-9d4c-4bb6-a1fd-ea7e6e23f799 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1219 microversion: 2.1 time: 0.066942 Apr 12 15:01:29.771668 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 449/877] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:29 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:30.059234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f9f2a60a-2947-4378-adf9-b76cad240c2a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:30.059839 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f9f2a60a-2947-4378-adf9-b76cad240c2a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:30.074178 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9f2a60a-2947-4378-adf9-b76cad240c2a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:30.074623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9f2a60a-2947-4378-adf9-b76cad240c2a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:30.075395 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9f2a60a-2947-4378-adf9-b76cad240c2a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:30.076738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9f2a60a-2947-4378-adf9-b76cad240c2a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:30.162285 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f9f2a60a-2947-4378-adf9-b76cad240c2a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:30.172937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f9f2a60a-2947-4378-adf9-b76cad240c2a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1265 microversion: 2.1 time: 0.117585 Apr 12 15:01:30.173984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 429/878] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:30 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:30.788742 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3a44a047-dee3-4fb6-aa28-47356c6ae46d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:30.790421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3a44a047-dee3-4fb6-aa28-47356c6ae46d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:30.797746 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3a44a047-dee3-4fb6-aa28-47356c6ae46d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:30.798502 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3a44a047-dee3-4fb6-aa28-47356c6ae46d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:30.799850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3a44a047-dee3-4fb6-aa28-47356c6ae46d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:30.800675 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3a44a047-dee3-4fb6-aa28-47356c6ae46d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:30.881185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3a44a047-dee3-4fb6-aa28-47356c6ae46d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:30.889705 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3a44a047-dee3-4fb6-aa28-47356c6ae46d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1215 microversion: 2.1 time: 0.105348 Apr 12 15:01:30.890284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 450/879] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:30 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:31.199529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-88bcef04-a091-4042-9a47-50cd19410987 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:31.200200 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-88bcef04-a091-4042-9a47-50cd19410987 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:31.206570 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88bcef04-a091-4042-9a47-50cd19410987 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:31.207048 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88bcef04-a091-4042-9a47-50cd19410987 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:31.207835 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88bcef04-a091-4042-9a47-50cd19410987 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:31.209002 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88bcef04-a091-4042-9a47-50cd19410987 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:31.275418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-88bcef04-a091-4042-9a47-50cd19410987 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:31.283487 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-88bcef04-a091-4042-9a47-50cd19410987 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1283 microversion: 2.1 time: 0.088328 Apr 12 15:01:31.284183 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 430/880] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:31 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1283 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:31.910301 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0f4e8e36-30dd-4efc-9015-31f3f78f39c4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:31.910911 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0f4e8e36-30dd-4efc-9015-31f3f78f39c4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:31.922563 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f4e8e36-30dd-4efc-9015-31f3f78f39c4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:31.923363 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f4e8e36-30dd-4efc-9015-31f3f78f39c4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:31.924348 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f4e8e36-30dd-4efc-9015-31f3f78f39c4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:31.927954 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f4e8e36-30dd-4efc-9015-31f3f78f39c4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:31.999507 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0f4e8e36-30dd-4efc-9015-31f3f78f39c4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:32.010437 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0f4e8e36-30dd-4efc-9015-31f3f78f39c4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1279 microversion: 2.1 time: 0.103986 Apr 12 15:01:32.011098 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 451/881] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:31 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:32.301521 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f918ae98-198b-497a-856b-639b82c324a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:32.302183 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f918ae98-198b-497a-856b-639b82c324a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:32.316428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f918ae98-198b-497a-856b-639b82c324a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:32.317421 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f918ae98-198b-497a-856b-639b82c324a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:32.319572 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f918ae98-198b-497a-856b-639b82c324a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:32.320425 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f918ae98-198b-497a-856b-639b82c324a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:32.503365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f918ae98-198b-497a-856b-639b82c324a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:32.515807 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f918ae98-198b-497a-856b-639b82c324a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1313 microversion: 2.1 time: 0.217721 Apr 12 15:01:32.516711 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 431/882] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:32 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:33.028216 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0f947d56-d8f6-4f32-b1e8-76e4902fd5db tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:33.028816 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0f947d56-d8f6-4f32-b1e8-76e4902fd5db tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:33.035518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f947d56-d8f6-4f32-b1e8-76e4902fd5db tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:33.035961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f947d56-d8f6-4f32-b1e8-76e4902fd5db tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:33.041328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f947d56-d8f6-4f32-b1e8-76e4902fd5db tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:33.041328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0f947d56-d8f6-4f32-b1e8-76e4902fd5db tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:33.106048 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0f947d56-d8f6-4f32-b1e8-76e4902fd5db tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:33.115313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0f947d56-d8f6-4f32-b1e8-76e4902fd5db tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1277 microversion: 2.1 time: 0.090333 Apr 12 15:01:33.116594 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 452/883] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:33 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:33.312394 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-28f98195-ac2d-4d70-9a82-1b32d15b0aa1 req-1ea006ce-0ec2-431a-aec2-ce36d0300e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e48354-85df-4e83-819c-4a0de5f564e8", "tag": "ea6c5815-80b7-4e50-a9cd-6b3a12db4b29"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:33.330063 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-28f98195-ac2d-4d70-9a82-1b32d15b0aa1 req-1ea006ce-0ec2-431a-aec2-ce36d0300e7e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:33.330918 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-28f98195-ac2d-4d70-9a82-1b32d15b0aa1 req-1ea006ce-0ec2-431a-aec2-ce36d0300e7e service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:33.353203 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-28f98195-ac2d-4d70-9a82-1b32d15b0aa1 req-1ea006ce-0ec2-431a-aec2-ce36d0300e7e service nova] Creating event network-changed:ea6c5815-80b7-4e50-a9cd-6b3a12db4b29 for instance 43e48354-85df-4e83-819c-4a0de5f564e8 on hv-cinder-83752 Apr 12 15:01:33.362445 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-28f98195-ac2d-4d70-9a82-1b32d15b0aa1 req-1ea006ce-0ec2-431a-aec2-ce36d0300e7e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056322 Apr 12 15:01:33.363698 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 432/884] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 15:01:33.535590 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9e582d0f-6104-4721-b2f6-0090669d5660 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:33.536193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9e582d0f-6104-4721-b2f6-0090669d5660 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:33.548619 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e582d0f-6104-4721-b2f6-0090669d5660 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:33.549087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e582d0f-6104-4721-b2f6-0090669d5660 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:33.550277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e582d0f-6104-4721-b2f6-0090669d5660 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:33.550884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e582d0f-6104-4721-b2f6-0090669d5660 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:33.694829 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9e582d0f-6104-4721-b2f6-0090669d5660 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:33.702756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9e582d0f-6104-4721-b2f6-0090669d5660 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1313 microversion: 2.1 time: 0.170712 Apr 12 15:01:33.702974 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 453/885] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:33 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:34.134054 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-43c0cb0f-ba09-4dc6-80d6-efba7c3fcd1e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:34.134949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-43c0cb0f-ba09-4dc6-80d6-efba7c3fcd1e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:34.141774 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43c0cb0f-ba09-4dc6-80d6-efba7c3fcd1e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:34.142313 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43c0cb0f-ba09-4dc6-80d6-efba7c3fcd1e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:34.143229 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43c0cb0f-ba09-4dc6-80d6-efba7c3fcd1e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:34.143664 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43c0cb0f-ba09-4dc6-80d6-efba7c3fcd1e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:34.304290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-43c0cb0f-ba09-4dc6-80d6-efba7c3fcd1e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:34.312807 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-43c0cb0f-ba09-4dc6-80d6-efba7c3fcd1e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1319 microversion: 2.1 time: 0.183895 Apr 12 15:01:34.313700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 433/886] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:34 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:34.720995 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0d47edd8-8f4e-4ba9-80e9-d66f5bac2151 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:34.721831 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0d47edd8-8f4e-4ba9-80e9-d66f5bac2151 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:34.729213 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d47edd8-8f4e-4ba9-80e9-d66f5bac2151 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:34.729799 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d47edd8-8f4e-4ba9-80e9-d66f5bac2151 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:34.730644 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d47edd8-8f4e-4ba9-80e9-d66f5bac2151 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:34.731145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0d47edd8-8f4e-4ba9-80e9-d66f5bac2151 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:34.870664 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0d47edd8-8f4e-4ba9-80e9-d66f5bac2151 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:34.879544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0d47edd8-8f4e-4ba9-80e9-d66f5bac2151 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1313 microversion: 2.1 time: 0.162442 Apr 12 15:01:34.880851 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 454/887] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:34 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:01:35.333143 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-676cbb4f-3209-4dd9-9609-6b53632c2e78 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:35.334528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-676cbb4f-3209-4dd9-9609-6b53632c2e78 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:35.340935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-676cbb4f-3209-4dd9-9609-6b53632c2e78 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:35.341456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-676cbb4f-3209-4dd9-9609-6b53632c2e78 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:35.342344 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-676cbb4f-3209-4dd9-9609-6b53632c2e78 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:35.342836 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-676cbb4f-3209-4dd9-9609-6b53632c2e78 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:35.386524 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-a131d773-55fc-4635-abcd-508478fa7abb req-cf320ed8-f3f9-4dde-ac8d-7d799b257914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39507a5-c1c1-4c1f-b6f2-bc75f4807e80", "tag": "9451047e-0681-4617-98f0-222c5f69ceb6"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:35.395119 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-a131d773-55fc-4635-abcd-508478fa7abb req-cf320ed8-f3f9-4dde-ac8d-7d799b257914 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:35.396590 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-a131d773-55fc-4635-abcd-508478fa7abb req-cf320ed8-f3f9-4dde-ac8d-7d799b257914 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:35.407795 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-a131d773-55fc-4635-abcd-508478fa7abb req-cf320ed8-f3f9-4dde-ac8d-7d799b257914 service nova] Creating event network-changed:9451047e-0681-4617-98f0-222c5f69ceb6 for instance b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 on hv-cinder-83752 Apr 12 15:01:35.415093 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-a131d773-55fc-4635-abcd-508478fa7abb req-cf320ed8-f3f9-4dde-ac8d-7d799b257914 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036385 Apr 12 15:01:35.415992 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 455/888] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:01:35.486886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-676cbb4f-3209-4dd9-9609-6b53632c2e78 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:35.494508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-676cbb4f-3209-4dd9-9609-6b53632c2e78 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1319 microversion: 2.1 time: 0.165453 Apr 12 15:01:35.495220 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 434/889] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:35 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:35.900923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d0a7507c-6287-4307-8da7-f4db7dbc35ea tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:35.901648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d0a7507c-6287-4307-8da7-f4db7dbc35ea tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:35.907940 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0a7507c-6287-4307-8da7-f4db7dbc35ea tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:35.908398 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0a7507c-6287-4307-8da7-f4db7dbc35ea tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:35.909177 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0a7507c-6287-4307-8da7-f4db7dbc35ea tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:35.909614 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0a7507c-6287-4307-8da7-f4db7dbc35ea tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:36.050970 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d0a7507c-6287-4307-8da7-f4db7dbc35ea tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:36.058662 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d0a7507c-6287-4307-8da7-f4db7dbc35ea tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1313 microversion: 2.1 time: 0.166011 Apr 12 15:01:36.059206 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 456/890] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:35 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:01:36.514122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e22ef94b-8288-418e-97b4-8b4102e60abb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:36.515156 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e22ef94b-8288-418e-97b4-8b4102e60abb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:36.533854 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e22ef94b-8288-418e-97b4-8b4102e60abb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:36.534665 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e22ef94b-8288-418e-97b4-8b4102e60abb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:36.536097 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e22ef94b-8288-418e-97b4-8b4102e60abb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:36.537705 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e22ef94b-8288-418e-97b4-8b4102e60abb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:36.697524 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e22ef94b-8288-418e-97b4-8b4102e60abb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:36.705156 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e22ef94b-8288-418e-97b4-8b4102e60abb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1319 microversion: 2.1 time: 0.196651 Apr 12 15:01:36.705840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 435/891] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:36 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:37.077944 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dc41288e-2737-4c4d-bc22-5c1db62f7701 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:37.081166 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dc41288e-2737-4c4d-bc22-5c1db62f7701 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:37.086399 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc41288e-2737-4c4d-bc22-5c1db62f7701 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:37.086882 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc41288e-2737-4c4d-bc22-5c1db62f7701 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:37.087650 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc41288e-2737-4c4d-bc22-5c1db62f7701 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:37.088087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dc41288e-2737-4c4d-bc22-5c1db62f7701 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:37.220293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dc41288e-2737-4c4d-bc22-5c1db62f7701 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:37.228369 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dc41288e-2737-4c4d-bc22-5c1db62f7701 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1313 microversion: 2.1 time: 0.155013 Apr 12 15:01:37.228928 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 457/892] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:37 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:37.722260 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e622e63b-d490-494e-b148-aba3856bca83 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:37.722891 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e622e63b-d490-494e-b148-aba3856bca83 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:37.729824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e622e63b-d490-494e-b148-aba3856bca83 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:37.730332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e622e63b-d490-494e-b148-aba3856bca83 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:37.731041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e622e63b-d490-494e-b148-aba3856bca83 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:37.731469 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e622e63b-d490-494e-b148-aba3856bca83 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:37.911146 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e622e63b-d490-494e-b148-aba3856bca83 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:37.921794 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e622e63b-d490-494e-b148-aba3856bca83 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1319 microversion: 2.1 time: 0.203269 Apr 12 15:01:37.930389 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 436/893] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:37 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:01:38.246110 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9a93f1f9-ae22-423a-ae90-66c62cec8771 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:38.246942 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9a93f1f9-ae22-423a-ae90-66c62cec8771 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:38.254093 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a93f1f9-ae22-423a-ae90-66c62cec8771 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:38.255295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a93f1f9-ae22-423a-ae90-66c62cec8771 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:38.257086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a93f1f9-ae22-423a-ae90-66c62cec8771 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:38.257768 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a93f1f9-ae22-423a-ae90-66c62cec8771 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:38.422364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9a93f1f9-ae22-423a-ae90-66c62cec8771 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:38.430233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9a93f1f9-ae22-423a-ae90-66c62cec8771 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1313 microversion: 2.1 time: 0.188950 Apr 12 15:01:38.430902 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 458/894] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:38 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:38.939733 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a395a4f1-8a46-4d8e-9dfb-ad99ab920669 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:38.940337 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a395a4f1-8a46-4d8e-9dfb-ad99ab920669 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:38.947959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a395a4f1-8a46-4d8e-9dfb-ad99ab920669 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:38.949133 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a395a4f1-8a46-4d8e-9dfb-ad99ab920669 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:38.949133 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a395a4f1-8a46-4d8e-9dfb-ad99ab920669 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:38.949566 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a395a4f1-8a46-4d8e-9dfb-ad99ab920669 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:39.079311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a395a4f1-8a46-4d8e-9dfb-ad99ab920669 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:39.087686 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a395a4f1-8a46-4d8e-9dfb-ad99ab920669 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1319 microversion: 2.1 time: 0.151819 Apr 12 15:01:39.088186 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 437/895] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:38 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:39.449030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-54386c33-5e96-427f-988f-07db57662f4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:39.450287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-54386c33-5e96-427f-988f-07db57662f4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:39.457652 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54386c33-5e96-427f-988f-07db57662f4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:39.458272 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54386c33-5e96-427f-988f-07db57662f4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:39.459681 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54386c33-5e96-427f-988f-07db57662f4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:39.459681 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54386c33-5e96-427f-988f-07db57662f4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:39.603899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-54386c33-5e96-427f-988f-07db57662f4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:39.612193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-54386c33-5e96-427f-988f-07db57662f4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1313 microversion: 2.1 time: 0.166929 Apr 12 15:01:39.612909 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 459/896] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:39 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:39.702063 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-749337ca-b4e2-471e-b27c-252aac53ccdd req-9afd8be1-f212-4051-a70e-140553c79c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e48354-85df-4e83-819c-4a0de5f564e8", "name": "network-vif-plugged", "status": "completed", "tag": "ea6c5815-80b7-4e50-a9cd-6b3a12db4b29"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:39.711311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-749337ca-b4e2-471e-b27c-252aac53ccdd req-9afd8be1-f212-4051-a70e-140553c79c54 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:39.711903 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-749337ca-b4e2-471e-b27c-252aac53ccdd req-9afd8be1-f212-4051-a70e-140553c79c54 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:39.724178 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-749337ca-b4e2-471e-b27c-252aac53ccdd req-9afd8be1-f212-4051-a70e-140553c79c54 service nova] Creating event network-vif-plugged:ea6c5815-80b7-4e50-a9cd-6b3a12db4b29 for instance 43e48354-85df-4e83-819c-4a0de5f564e8 on hv-cinder-83752 Apr 12 15:01:39.730730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-749337ca-b4e2-471e-b27c-252aac53ccdd req-9afd8be1-f212-4051-a70e-140553c79c54 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032070 Apr 12 15:01:39.732074 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 438/897] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:01:40.104616 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7ad64a80-9202-45bf-a4f2-c310e62f01c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:40.105233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7ad64a80-9202-45bf-a4f2-c310e62f01c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:40.111803 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ad64a80-9202-45bf-a4f2-c310e62f01c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:40.112262 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ad64a80-9202-45bf-a4f2-c310e62f01c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:40.113043 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ad64a80-9202-45bf-a4f2-c310e62f01c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:40.113875 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ad64a80-9202-45bf-a4f2-c310e62f01c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:40.253764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7ad64a80-9202-45bf-a4f2-c310e62f01c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:40.261656 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7ad64a80-9202-45bf-a4f2-c310e62f01c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1319 microversion: 2.1 time: 0.161031 Apr 12 15:01:40.262232 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 460/898] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:40 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:01:40.629649 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-743ccde2-39f4-41b1-8327-05234f62b118 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:40.630414 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-743ccde2-39f4-41b1-8327-05234f62b118 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:40.636364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-743ccde2-39f4-41b1-8327-05234f62b118 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:40.636822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-743ccde2-39f4-41b1-8327-05234f62b118 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:40.637724 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-743ccde2-39f4-41b1-8327-05234f62b118 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:40.638330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-743ccde2-39f4-41b1-8327-05234f62b118 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:40.770051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-743ccde2-39f4-41b1-8327-05234f62b118 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:40.778027 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-743ccde2-39f4-41b1-8327-05234f62b118 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1313 microversion: 2.1 time: 0.153073 Apr 12 15:01:40.778608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 439/899] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:40 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:01:41.278735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-64fe57be-7e64-4346-9174-0ccfbbdd1034 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:41.280033 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-64fe57be-7e64-4346-9174-0ccfbbdd1034 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:41.288016 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-64fe57be-7e64-4346-9174-0ccfbbdd1034 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:41.288456 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-64fe57be-7e64-4346-9174-0ccfbbdd1034 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:41.289298 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-64fe57be-7e64-4346-9174-0ccfbbdd1034 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:41.289901 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-64fe57be-7e64-4346-9174-0ccfbbdd1034 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:41.441726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-64fe57be-7e64-4346-9174-0ccfbbdd1034 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:41.449999 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-64fe57be-7e64-4346-9174-0ccfbbdd1034 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1319 microversion: 2.1 time: 0.175012 Apr 12 15:01:41.450571 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 461/900] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:41 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:41.747578 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-1eeff0ce-47d8-44a4-9c15-cc573852e55e req-85cc9ccc-4a9a-4841-b665-975e15c367fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39507a5-c1c1-4c1f-b6f2-bc75f4807e80", "name": "network-vif-plugged", "status": "completed", "tag": "9451047e-0681-4617-98f0-222c5f69ceb6"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:41.757819 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-1eeff0ce-47d8-44a4-9c15-cc573852e55e req-85cc9ccc-4a9a-4841-b665-975e15c367fa service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:41.758265 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-1eeff0ce-47d8-44a4-9c15-cc573852e55e req-85cc9ccc-4a9a-4841-b665-975e15c367fa service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:41.769713 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-1eeff0ce-47d8-44a4-9c15-cc573852e55e req-85cc9ccc-4a9a-4841-b665-975e15c367fa service nova] Creating event network-vif-plugged:9451047e-0681-4617-98f0-222c5f69ceb6 for instance b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 on hv-cinder-83752 Apr 12 15:01:41.775501 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-1eeff0ce-47d8-44a4-9c15-cc573852e55e req-85cc9ccc-4a9a-4841-b665-975e15c367fa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030769 Apr 12 15:01:41.775501 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 440/901] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:01:41.800082 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f6b1d30b-43d4-41ed-8108-6e076e7d76ec tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:41.800082 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f6b1d30b-43d4-41ed-8108-6e076e7d76ec tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:41.804915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6b1d30b-43d4-41ed-8108-6e076e7d76ec tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:41.805775 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6b1d30b-43d4-41ed-8108-6e076e7d76ec tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:41.806754 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6b1d30b-43d4-41ed-8108-6e076e7d76ec tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:41.807483 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f6b1d30b-43d4-41ed-8108-6e076e7d76ec tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:41.947623 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f6b1d30b-43d4-41ed-8108-6e076e7d76ec tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:41.955075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f6b1d30b-43d4-41ed-8108-6e076e7d76ec tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1497 microversion: 2.1 time: 0.162619 Apr 12 15:01:41.955661 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 462/902] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:41 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:42.467566 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f1453168-0dff-41cd-8d44-70b134659b0d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:42.468378 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f1453168-0dff-41cd-8d44-70b134659b0d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:42.475808 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f1453168-0dff-41cd-8d44-70b134659b0d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:42.476251 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f1453168-0dff-41cd-8d44-70b134659b0d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:42.477003 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f1453168-0dff-41cd-8d44-70b134659b0d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:42.477447 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f1453168-0dff-41cd-8d44-70b134659b0d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:42.649919 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f1453168-0dff-41cd-8d44-70b134659b0d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:42.658164 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f1453168-0dff-41cd-8d44-70b134659b0d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1319 microversion: 2.1 time: 0.194748 Apr 12 15:01:42.659069 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 441/903] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:42 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:43.002570 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f1f6c5c6-f0b9-45f7-b6fd-4a132c697438 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:43.003172 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f1f6c5c6-f0b9-45f7-b6fd-4a132c697438 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:43.011380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f1f6c5c6-f0b9-45f7-b6fd-4a132c697438 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:43.011828 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f1f6c5c6-f0b9-45f7-b6fd-4a132c697438 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:43.013188 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f1f6c5c6-f0b9-45f7-b6fd-4a132c697438 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:43.014013 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f1f6c5c6-f0b9-45f7-b6fd-4a132c697438 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:43.040482 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f1f6c5c6-f0b9-45f7-b6fd-4a132c697438 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 15:01:43.312307 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f1f6c5c6-f0b9-45f7-b6fd-4a132c697438 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "DELETE /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 204 len: 0 microversion: 2.1 time: 0.314424 Apr 12 15:01:43.312927 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 463/904] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:01:42 2022] DELETE /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 15:01:43.328999 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-24c9b1f8-dd1c-4187-8c1a-d58f25d43b22 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:43.329838 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-24c9b1f8-dd1c-4187-8c1a-d58f25d43b22 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:43.337880 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-24c9b1f8-dd1c-4187-8c1a-d58f25d43b22 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:43.338509 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-24c9b1f8-dd1c-4187-8c1a-d58f25d43b22 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:43.339376 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-24c9b1f8-dd1c-4187-8c1a-d58f25d43b22 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:43.339818 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-24c9b1f8-dd1c-4187-8c1a-d58f25d43b22 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:43.499082 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-24c9b1f8-dd1c-4187-8c1a-d58f25d43b22 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:43.507264 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-24c9b1f8-dd1c-4187-8c1a-d58f25d43b22 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1503 microversion: 2.1 time: 0.190026 Apr 12 15:01:43.508098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 442/905] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:43 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:43.676161 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f75c699b-2884-472a-bf26-caeb8553e292 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:43.676776 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f75c699b-2884-472a-bf26-caeb8553e292 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:43.683521 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f75c699b-2884-472a-bf26-caeb8553e292 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:43.686878 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f75c699b-2884-472a-bf26-caeb8553e292 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:43.686878 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f75c699b-2884-472a-bf26-caeb8553e292 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:43.686878 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f75c699b-2884-472a-bf26-caeb8553e292 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:43.881795 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f75c699b-2884-472a-bf26-caeb8553e292 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:43.889572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f75c699b-2884-472a-bf26-caeb8553e292 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1319 microversion: 2.1 time: 0.217691 Apr 12 15:01:43.890269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 464/906] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:43 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:44.524977 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c6823281-bf19-457b-944a-e6f3e7022ad5 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:44.525583 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c6823281-bf19-457b-944a-e6f3e7022ad5 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:44.538037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6823281-bf19-457b-944a-e6f3e7022ad5 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:44.538522 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6823281-bf19-457b-944a-e6f3e7022ad5 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:44.539343 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6823281-bf19-457b-944a-e6f3e7022ad5 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:44.539719 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c6823281-bf19-457b-944a-e6f3e7022ad5 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:44.747062 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c6823281-bf19-457b-944a-e6f3e7022ad5 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:44.756463 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c6823281-bf19-457b-944a-e6f3e7022ad5 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1503 microversion: 2.1 time: 0.235908 Apr 12 15:01:44.757382 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 443/907] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:44 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:44.907054 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5212101c-d4cc-43c5-bc8b-a5315489684d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:44.907699 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5212101c-d4cc-43c5-bc8b-a5315489684d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:44.915212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5212101c-d4cc-43c5-bc8b-a5315489684d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:44.916313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5212101c-d4cc-43c5-bc8b-a5315489684d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:44.917184 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5212101c-d4cc-43c5-bc8b-a5315489684d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:44.917617 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5212101c-d4cc-43c5-bc8b-a5315489684d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:45.140372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5212101c-d4cc-43c5-bc8b-a5315489684d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:45.154501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5212101c-d4cc-43c5-bc8b-a5315489684d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1508 microversion: 2.1 time: 0.251305 Apr 12 15:01:45.155355 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 465/908] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:44 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:45.648380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-7e6bb236-2c5d-4418-8f55-abb7ed06014a req-69282fbb-090f-48ea-b6d7-825ed485b5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e48354-85df-4e83-819c-4a0de5f564e8", "name": "network-vif-deleted", "tag": "ea6c5815-80b7-4e50-a9cd-6b3a12db4b29"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:45.664563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-7e6bb236-2c5d-4418-8f55-abb7ed06014a req-69282fbb-090f-48ea-b6d7-825ed485b5cf service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:45.665171 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-7e6bb236-2c5d-4418-8f55-abb7ed06014a req-69282fbb-090f-48ea-b6d7-825ed485b5cf service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:45.685118 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-7e6bb236-2c5d-4418-8f55-abb7ed06014a req-69282fbb-090f-48ea-b6d7-825ed485b5cf service nova] Creating event network-vif-deleted:ea6c5815-80b7-4e50-a9cd-6b3a12db4b29 for instance 43e48354-85df-4e83-819c-4a0de5f564e8 on hv-cinder-83752 Apr 12 15:01:45.690586 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-7e6bb236-2c5d-4418-8f55-abb7ed06014a req-69282fbb-090f-48ea-b6d7-825ed485b5cf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054424 Apr 12 15:01:45.691627 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 444/909] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:01:45.774270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1caa7579-7595-4f9d-b757-4a75054391de tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:45.774902 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1caa7579-7595-4f9d-b757-4a75054391de tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:45.783591 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1caa7579-7595-4f9d-b757-4a75054391de tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:45.784087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1caa7579-7595-4f9d-b757-4a75054391de tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:45.784873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1caa7579-7595-4f9d-b757-4a75054391de tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:45.785313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1caa7579-7595-4f9d-b757-4a75054391de tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:45.864849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1caa7579-7595-4f9d-b757-4a75054391de tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:45.872910 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1caa7579-7595-4f9d-b757-4a75054391de tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1461 microversion: 2.1 time: 0.102784 Apr 12 15:01:45.873645 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 466/910] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:45 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1461 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:46.892779 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:46.893387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:46.899988 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:46.900549 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:46.901408 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:46.901881 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:46.950785 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:46.951230 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:46.951686 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lazy-loading 'fault' on Instance uuid 43e48354-85df-4e83-819c-4a0de5f564e8 {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 15:01:47.001212 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:47.011934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e0b7038f-c6a7-4f8c-94c6-0052c235a89f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 200 len: 1303 microversion: 2.1 time: 0.121250 Apr 12 15:01:47.011934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 445/911] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:46 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:48.029148 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5c85432e-ac5e-40ca-ac5a-d1f59d869764 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:48.030277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5c85432e-ac5e-40ca-ac5a-d1f59d869764 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: 43e48354-85df-4e83-819c-4a0de5f564e8] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:48.038698 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5c85432e-ac5e-40ca-ac5a-d1f59d869764 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:48.039239 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5c85432e-ac5e-40ca-ac5a-d1f59d869764 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:48.040367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5c85432e-ac5e-40ca-ac5a-d1f59d869764 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:48.040876 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5c85432e-ac5e-40ca-ac5a-d1f59d869764 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:48.056723 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-5c85432e-ac5e-40ca-ac5a-d1f59d869764 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] HTTP exception thrown: Instance 43e48354-85df-4e83-819c-4a0de5f564e8 could not be found. Apr 12 15:01:48.057347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5c85432e-ac5e-40ca-ac5a-d1f59d869764 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Returning 404 to user: Instance 43e48354-85df-4e83-819c-4a0de5f564e8 could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:01:48.058212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5c85432e-ac5e-40ca-ac5a-d1f59d869764 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8" status: 404 len: 111 microversion: 2.1 time: 0.034348 Apr 12 15:01:48.067411 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 467/912] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:48 2022] GET /compute/v2.1/servers/43e48354-85df-4e83-819c-4a0de5f564e8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 15:01:48.175846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2073529661", "imageRef": "1a0ac802-1ee1-41b7-a638-97326f6015cc", "flavorRef": "452", "networks": [{"uuid": "e057c56c-da75-44fd-9833-db52affcb73c"}]}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:48.245394 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.network.neutron [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] validate_networks() for [('e057c56c-da75-44fd-9833-db52affcb73c', None, None, None, None, None)] {{(pid=124198) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 15:01:48.991038 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Flavor limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:01:48.995416 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Image limits 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:01:48.996696 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Flavor pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:01:48.997722 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Image pref 0:0:0 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:01:48.998413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.virt.hardware [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:01:49.009671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:49.010203 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:49.011208 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:49.011663 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:49.038985 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Getting quotas for project 6ca047ef87324b72abe1a98bc09e9d34. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:01:49.043947 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Getting quotas for user a9f5e7c5f43244c482021ab669b4d67f and project 6ca047ef87324b72abe1a98bc09e9d34. Resources: {'ram', 'cores', 'instances'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:01:49.058288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Going to run 1 instances... {{(pid=124198) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 15:01:49.061447 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a0ac802-1ee1-41b7-a638-97326f6015cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 15:01:49.207912 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ad8d3e0b-cff3-4aa7-aad9-55759327b382 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040812 Apr 12 15:01:49.209645 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 446/913] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 15:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 12 15:01:49.223863 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c65053e0-d3c5-40a6-ac99-4fd6ceb9ffa9 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:49.223863 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c65053e0-d3c5-40a6-ac99-4fd6ceb9ffa9 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:49.321490 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c65053e0-d3c5-40a6-ac99-4fd6ceb9ffa9 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:49.341099 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c65053e0-d3c5-40a6-ac99-4fd6ceb9ffa9 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1214 microversion: 2.1 time: 0.122634 Apr 12 15:01:49.342971 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 468/914] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:49 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:50.363254 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a606c189-4278-4646-85bf-6a6843e4ddc8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:50.365950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a606c189-4278-4646-85bf-6a6843e4ddc8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:50.375027 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a606c189-4278-4646-85bf-6a6843e4ddc8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:50.375646 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a606c189-4278-4646-85bf-6a6843e4ddc8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:50.376428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a606c189-4278-4646-85bf-6a6843e4ddc8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:50.376861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a606c189-4278-4646-85bf-6a6843e4ddc8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:50.454076 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a606c189-4278-4646-85bf-6a6843e4ddc8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:50.462239 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a606c189-4278-4646-85bf-6a6843e4ddc8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1218 microversion: 2.1 time: 0.103990 Apr 12 15:01:50.463012 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 447/915] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:50 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:51.480233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-af3a054e-e8f8-43b9-93f9-156c42dda956 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:51.481277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-af3a054e-e8f8-43b9-93f9-156c42dda956 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:51.495124 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-af3a054e-e8f8-43b9-93f9-156c42dda956 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:51.495610 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-af3a054e-e8f8-43b9-93f9-156c42dda956 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:51.496413 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-af3a054e-e8f8-43b9-93f9-156c42dda956 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:51.496853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-af3a054e-e8f8-43b9-93f9-156c42dda956 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:51.600572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-af3a054e-e8f8-43b9-93f9-156c42dda956 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:51.616537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-af3a054e-e8f8-43b9-93f9-156c42dda956 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1266 microversion: 2.1 time: 0.140286 Apr 12 15:01:51.617774 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 469/916] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:51 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:52.638135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f3b60ccf-fa3a-4296-a11c-da39b1ae6930 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:52.641124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f3b60ccf-fa3a-4296-a11c-da39b1ae6930 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:52.650603 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f3b60ccf-fa3a-4296-a11c-da39b1ae6930 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:52.655237 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f3b60ccf-fa3a-4296-a11c-da39b1ae6930 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:52.656188 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f3b60ccf-fa3a-4296-a11c-da39b1ae6930 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:52.656641 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f3b60ccf-fa3a-4296-a11c-da39b1ae6930 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:52.810539 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f3b60ccf-fa3a-4296-a11c-da39b1ae6930 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:52.821816 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f3b60ccf-fa3a-4296-a11c-da39b1ae6930 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1272 microversion: 2.1 time: 0.188931 Apr 12 15:01:52.822958 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 448/917] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:52 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:53.840382 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5fe728eb-ae82-4ae2-be2a-3c8c88830cd2 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:53.842040 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5fe728eb-ae82-4ae2-be2a-3c8c88830cd2 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:53.851298 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5fe728eb-ae82-4ae2-be2a-3c8c88830cd2 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:53.851876 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5fe728eb-ae82-4ae2-be2a-3c8c88830cd2 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:53.853025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5fe728eb-ae82-4ae2-be2a-3c8c88830cd2 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:53.853545 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5fe728eb-ae82-4ae2-be2a-3c8c88830cd2 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:54.042295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5fe728eb-ae82-4ae2-be2a-3c8c88830cd2 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:54.050020 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5fe728eb-ae82-4ae2-be2a-3c8c88830cd2 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1314 microversion: 2.1 time: 0.213335 Apr 12 15:01:54.051326 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 470/918] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:53 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:54.776426 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-6e454598-e2df-45e9-b2b9-07e737526065 req-a86177ae-ed75-4e2c-a52a-812da0f48a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b", "tag": "ef67d5e4-d69e-4f55-8ca4-2c98f273d3c5"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:54.794568 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-6e454598-e2df-45e9-b2b9-07e737526065 req-a86177ae-ed75-4e2c-a52a-812da0f48a46 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:54.795144 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-6e454598-e2df-45e9-b2b9-07e737526065 req-a86177ae-ed75-4e2c-a52a-812da0f48a46 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:54.818051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-6e454598-e2df-45e9-b2b9-07e737526065 req-a86177ae-ed75-4e2c-a52a-812da0f48a46 service nova] Creating event network-changed:ef67d5e4-d69e-4f55-8ca4-2c98f273d3c5 for instance fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b on hv-cinder-83752 Apr 12 15:01:54.826395 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-6e454598-e2df-45e9-b2b9-07e737526065 req-a86177ae-ed75-4e2c-a52a-812da0f48a46 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055642 Apr 12 15:01:54.827650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 449/919] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 15:01:55.071726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-11adc83b-cbf8-4b75-bbf2-10d1882cf0c1 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:55.072346 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-11adc83b-cbf8-4b75-bbf2-10d1882cf0c1 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:55.079357 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11adc83b-cbf8-4b75-bbf2-10d1882cf0c1 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:55.079949 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11adc83b-cbf8-4b75-bbf2-10d1882cf0c1 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:55.080790 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11adc83b-cbf8-4b75-bbf2-10d1882cf0c1 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:55.081224 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11adc83b-cbf8-4b75-bbf2-10d1882cf0c1 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:55.251249 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-11adc83b-cbf8-4b75-bbf2-10d1882cf0c1 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:55.260433 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-11adc83b-cbf8-4b75-bbf2-10d1882cf0c1 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1314 microversion: 2.1 time: 0.196856 Apr 12 15:01:55.261115 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 471/920] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:55 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:01:56.293508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dfbc6cc8-7754-4546-8cc3-f53740184c63 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:56.294252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dfbc6cc8-7754-4546-8cc3-f53740184c63 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:56.300730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfbc6cc8-7754-4546-8cc3-f53740184c63 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:56.301412 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfbc6cc8-7754-4546-8cc3-f53740184c63 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:56.303642 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfbc6cc8-7754-4546-8cc3-f53740184c63 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:56.304253 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfbc6cc8-7754-4546-8cc3-f53740184c63 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:56.462084 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dfbc6cc8-7754-4546-8cc3-f53740184c63 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:56.470269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dfbc6cc8-7754-4546-8cc3-f53740184c63 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1314 microversion: 2.1 time: 0.181528 Apr 12 15:01:56.471058 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 450/921] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:56 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:57.489872 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-45ece62c-f174-48ad-8733-b3268f835918 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:57.490743 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-45ece62c-f174-48ad-8733-b3268f835918 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:57.503992 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45ece62c-f174-48ad-8733-b3268f835918 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:57.504759 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45ece62c-f174-48ad-8733-b3268f835918 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:57.505768 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45ece62c-f174-48ad-8733-b3268f835918 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:57.506296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45ece62c-f174-48ad-8733-b3268f835918 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:57.762758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-45ece62c-f174-48ad-8733-b3268f835918 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:57.771064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-45ece62c-f174-48ad-8733-b3268f835918 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1314 microversion: 2.1 time: 0.286022 Apr 12 15:01:57.771064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 472/922] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:57 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:58.790492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e5ef3a4b-9056-4326-a594-ad530f1b4f53 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:58.790492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e5ef3a4b-9056-4326-a594-ad530f1b4f53 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:01:58.794800 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a08bf0be-f745-4631-9abd-8111b3bfe25c tempest-TestVolumeBootPattern-691961796 tempest-TestVolumeBootPattern-691961796-project] Action: 'create', calling method: .version_select at 0x7fbd609d2700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1325964647"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:01:58.795213 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5ef3a4b-9056-4326-a594-ad530f1b4f53 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:58.795424 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5ef3a4b-9056-4326-a594-ad530f1b4f53 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:58.796202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5ef3a4b-9056-4326-a594-ad530f1b4f53 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:01:58.796640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5ef3a4b-9056-4326-a594-ad530f1b4f53 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:01:58.808707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-a08bf0be-f745-4631-9abd-8111b3bfe25c tempest-TestVolumeBootPattern-691961796 tempest-TestVolumeBootPattern-691961796-project] Getting quotas for project 1ec09fd1d0f3469aa239492b981b7c9f. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:01:58.812526 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-a08bf0be-f745-4631-9abd-8111b3bfe25c tempest-TestVolumeBootPattern-691961796 tempest-TestVolumeBootPattern-691961796-project] Getting quotas for user d5c93f8e6c9d4998ad006d7ca135439f and project 1ec09fd1d0f3469aa239492b981b7c9f. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:01:58.952248 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e5ef3a4b-9056-4326-a594-ad530f1b4f53 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:01:58.966603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e5ef3a4b-9056-4326-a594-ad530f1b4f53 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1314 microversion: 2.1 time: 0.178183 Apr 12 15:01:58.966603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 473/923] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:58 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:01:59.339359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-a08bf0be-f745-4631-9abd-8111b3bfe25c tempest-TestVolumeBootPattern-691961796 tempest-TestVolumeBootPattern-691961796-project] Getting quotas for project 1ec09fd1d0f3469aa239492b981b7c9f. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:01:59.343046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-a08bf0be-f745-4631-9abd-8111b3bfe25c tempest-TestVolumeBootPattern-691961796 tempest-TestVolumeBootPattern-691961796-project] Getting quotas for user d5c93f8e6c9d4998ad006d7ca135439f and project 1ec09fd1d0f3469aa239492b981b7c9f. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:01:59.357622 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a08bf0be-f745-4631-9abd-8111b3bfe25c tempest-TestVolumeBootPattern-691961796 tempest-TestVolumeBootPattern-691961796-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.740579 Apr 12 15:01:59.358252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 451/924] 10.222.0.64 () {60 vars in 1157 bytes} [Tue Apr 12 15:01:58 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:01:59.980966 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b8d7470a-8747-410b-a849-a14f29a26c32 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:01:59.983234 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b8d7470a-8747-410b-a849-a14f29a26c32 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:00.009463 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8d7470a-8747-410b-a849-a14f29a26c32 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:00.010661 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8d7470a-8747-410b-a849-a14f29a26c32 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:00.015734 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8d7470a-8747-410b-a849-a14f29a26c32 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:00.016436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8d7470a-8747-410b-a849-a14f29a26c32 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:00.240773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b8d7470a-8747-410b-a849-a14f29a26c32 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:00.249382 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b8d7470a-8747-410b-a849-a14f29a26c32 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1314 microversion: 2.1 time: 0.273590 Apr 12 15:02:00.250846 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 474/925] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:01:59 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:01.267552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5115df7a-d4e4-4ff2-bf66-3dce08e2005c tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:01.269266 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5115df7a-d4e4-4ff2-bf66-3dce08e2005c tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:01.280302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5115df7a-d4e4-4ff2-bf66-3dce08e2005c tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:01.280964 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5115df7a-d4e4-4ff2-bf66-3dce08e2005c tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:01.281922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5115df7a-d4e4-4ff2-bf66-3dce08e2005c tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:01.282510 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5115df7a-d4e4-4ff2-bf66-3dce08e2005c tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:01.575532 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5115df7a-d4e4-4ff2-bf66-3dce08e2005c tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:01.584116 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5115df7a-d4e4-4ff2-bf66-3dce08e2005c tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1314 microversion: 2.1 time: 0.320498 Apr 12 15:02:01.585088 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 452/926] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:01 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:01.968081 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-ec4597fb-61fb-4fb8-8a2c-991ebcef1311 req-b1255c3d-481e-453d-a3fc-61830c9e7262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b", "name": "network-vif-plugged", "status": "completed", "tag": "ef67d5e4-d69e-4f55-8ca4-2c98f273d3c5"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:02:01.982906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-ec4597fb-61fb-4fb8-8a2c-991ebcef1311 req-b1255c3d-481e-453d-a3fc-61830c9e7262 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:01.983603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-ec4597fb-61fb-4fb8-8a2c-991ebcef1311 req-b1255c3d-481e-453d-a3fc-61830c9e7262 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:02.008638 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-ec4597fb-61fb-4fb8-8a2c-991ebcef1311 req-b1255c3d-481e-453d-a3fc-61830c9e7262 service nova] Creating event network-vif-plugged:ef67d5e4-d69e-4f55-8ca4-2c98f273d3c5 for instance fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b on hv-cinder-83752 Apr 12 15:02:02.014481 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-ec4597fb-61fb-4fb8-8a2c-991ebcef1311 req-b1255c3d-481e-453d-a3fc-61830c9e7262 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051469 Apr 12 15:02:02.014707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 475/927] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:02:02.325454 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-14b880f7-8d51-4d5e-8519-e56edf61f971 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33946274-36b3-45eb-8f3b-ccfd6388a216", "device": "/dev/sdb"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:02:02.327715 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-14b880f7-8d51-4d5e-8519-e56edf61f971 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:02.336018 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-14b880f7-8d51-4d5e-8519-e56edf61f971 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:02.336710 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-14b880f7-8d51-4d5e-8519-e56edf61f971 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:02.338310 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-14b880f7-8d51-4d5e-8519-e56edf61f971 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:02.338956 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-14b880f7-8d51-4d5e-8519-e56edf61f971 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:02.604167 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-30e9af99-3d83-40b7-a1b0-bad724a1c18a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:02.604167 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-30e9af99-3d83-40b7-a1b0-bad724a1c18a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:02.610146 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30e9af99-3d83-40b7-a1b0-bad724a1c18a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:02.610701 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30e9af99-3d83-40b7-a1b0-bad724a1c18a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:02.611558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30e9af99-3d83-40b7-a1b0-bad724a1c18a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:02.612128 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-30e9af99-3d83-40b7-a1b0-bad724a1c18a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:02.765656 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-30e9af99-3d83-40b7-a1b0-bad724a1c18a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:02.775648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-30e9af99-3d83-40b7-a1b0-bad724a1c18a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1314 microversion: 2.1 time: 0.178139 Apr 12 15:02:02.776229 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 476/928] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:02 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:02:03.396835 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-14b880f7-8d51-4d5e-8519-e56edf61f971 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "POST /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.075850 Apr 12 15:02:03.397625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 453/929] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Apr 12 15:02:02 2022] POST /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80/os-volume_attachments => generated 194 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:02:03.792860 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0472b831-80d2-4a41-bc2c-2d8fb60de1a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:03.793457 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0472b831-80d2-4a41-bc2c-2d8fb60de1a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:03.799762 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0472b831-80d2-4a41-bc2c-2d8fb60de1a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:03.800198 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0472b831-80d2-4a41-bc2c-2d8fb60de1a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:03.800977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0472b831-80d2-4a41-bc2c-2d8fb60de1a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:03.802186 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0472b831-80d2-4a41-bc2c-2d8fb60de1a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:03.941025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0472b831-80d2-4a41-bc2c-2d8fb60de1a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:03.952734 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0472b831-80d2-4a41-bc2c-2d8fb60de1a4 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1314 microversion: 2.1 time: 0.163255 Apr 12 15:02:03.953386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 477/930] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:03 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:04.970881 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a5bb3e81-380b-42b5-96fc-ed82d1ff1a59 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:04.971579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a5bb3e81-380b-42b5-96fc-ed82d1ff1a59 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:04.979242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a5bb3e81-380b-42b5-96fc-ed82d1ff1a59 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:04.979687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a5bb3e81-380b-42b5-96fc-ed82d1ff1a59 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:04.980460 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a5bb3e81-380b-42b5-96fc-ed82d1ff1a59 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:04.980911 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a5bb3e81-380b-42b5-96fc-ed82d1ff1a59 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:05.125940 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a5bb3e81-380b-42b5-96fc-ed82d1ff1a59 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:05.134776 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a5bb3e81-380b-42b5-96fc-ed82d1ff1a59 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1497 microversion: 2.1 time: 0.168074 Apr 12 15:02:05.135428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 454/931] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:04 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:06.020141 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-57e11a05-eb91-4a50-97d2-6b8f9b6a6e7b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:06.020989 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-57e11a05-eb91-4a50-97d2-6b8f9b6a6e7b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:06.027587 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57e11a05-eb91-4a50-97d2-6b8f9b6a6e7b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:06.028031 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57e11a05-eb91-4a50-97d2-6b8f9b6a6e7b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:06.028800 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57e11a05-eb91-4a50-97d2-6b8f9b6a6e7b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:06.029274 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-57e11a05-eb91-4a50-97d2-6b8f9b6a6e7b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:06.056481 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-57e11a05-eb91-4a50-97d2-6b8f9b6a6e7b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 15:02:06.329655 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-57e11a05-eb91-4a50-97d2-6b8f9b6a6e7b tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 204 len: 0 microversion: 2.1 time: 0.313741 Apr 12 15:02:06.330200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 478/932] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:02:06 2022] DELETE /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 15:02:06.340040 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4ac4f294-de2e-412b-a662-7f9f216119dd tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:06.340669 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4ac4f294-de2e-412b-a662-7f9f216119dd tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:06.347082 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ac4f294-de2e-412b-a662-7f9f216119dd tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:06.347529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ac4f294-de2e-412b-a662-7f9f216119dd tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:06.348886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ac4f294-de2e-412b-a662-7f9f216119dd tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:06.349309 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ac4f294-de2e-412b-a662-7f9f216119dd tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:06.486710 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4ac4f294-de2e-412b-a662-7f9f216119dd tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:06.494399 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4ac4f294-de2e-412b-a662-7f9f216119dd tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1503 microversion: 2.1 time: 0.158248 Apr 12 15:02:06.495117 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 455/933] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:06 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:07.514113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9fb6edd5-9bf7-4f79-b8fc-e8b80ddb34be tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:07.514694 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9fb6edd5-9bf7-4f79-b8fc-e8b80ddb34be tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:07.521933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fb6edd5-9bf7-4f79-b8fc-e8b80ddb34be tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:07.522386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fb6edd5-9bf7-4f79-b8fc-e8b80ddb34be tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:07.523399 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fb6edd5-9bf7-4f79-b8fc-e8b80ddb34be tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:07.523830 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fb6edd5-9bf7-4f79-b8fc-e8b80ddb34be tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:07.664457 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fb6edd5-9bf7-4f79-b8fc-e8b80ddb34be tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:07.673235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9fb6edd5-9bf7-4f79-b8fc-e8b80ddb34be tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1503 microversion: 2.1 time: 0.163440 Apr 12 15:02:07.673998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 479/934] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:07 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:08.496839 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-3c82b8d9-a427-40fe-86ba-b89767ec4767 req-511ef495-56a1-4542-af55-4ed2937f07c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b", "name": "network-vif-deleted", "tag": "ef67d5e4-d69e-4f55-8ca4-2c98f273d3c5"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:02:08.505137 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-3c82b8d9-a427-40fe-86ba-b89767ec4767 req-511ef495-56a1-4542-af55-4ed2937f07c5 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:08.505583 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-3c82b8d9-a427-40fe-86ba-b89767ec4767 req-511ef495-56a1-4542-af55-4ed2937f07c5 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:08.518605 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-3c82b8d9-a427-40fe-86ba-b89767ec4767 req-511ef495-56a1-4542-af55-4ed2937f07c5 service nova] Creating event network-vif-deleted:ef67d5e4-d69e-4f55-8ca4-2c98f273d3c5 for instance fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b on hv-cinder-83752 Apr 12 15:02:08.524133 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-3c82b8d9-a427-40fe-86ba-b89767ec4767 req-511ef495-56a1-4542-af55-4ed2937f07c5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031082 Apr 12 15:02:08.524793 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 456/935] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:02:08.690808 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b794344d-80d5-4c61-a9da-869c1a03dc4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:08.691387 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b794344d-80d5-4c61-a9da-869c1a03dc4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:08.698914 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b794344d-80d5-4c61-a9da-869c1a03dc4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:08.699355 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b794344d-80d5-4c61-a9da-869c1a03dc4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:08.700122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b794344d-80d5-4c61-a9da-869c1a03dc4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:08.700544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b794344d-80d5-4c61-a9da-869c1a03dc4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:08.767019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b794344d-80d5-4c61-a9da-869c1a03dc4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:08.775732 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b794344d-80d5-4c61-a9da-869c1a03dc4f tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1299 microversion: 2.1 time: 0.088973 Apr 12 15:02:08.776305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 480/936] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:08 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:09.793949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:09.794646 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:09.802719 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:09.803322 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:09.804132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:09.804576 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:09.836029 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:09.843996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:09.843996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.objects.instance [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lazy-loading 'fault' on Instance uuid fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b {{(pid=124198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 15:02:09.888943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f5e7c5f43244c482021ab669b4d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca047ef87324b72abe1a98bc09e9d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:09.896539 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-25ab176b-c62c-45a9-94b1-4125bac083e8 tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 200 len: 1304 microversion: 2.1 time: 0.107526 Apr 12 15:02:09.897248 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 457/937] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:09 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:10.914426 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a3818c64-a06c-4e6f-bd5c-3f4467d4356a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:10.915187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a3818c64-a06c-4e6f-bd5c-3f4467d4356a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] [instance: fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:10.925475 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3818c64-a06c-4e6f-bd5c-3f4467d4356a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:10.926573 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3818c64-a06c-4e6f-bd5c-3f4467d4356a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:10.927600 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3818c64-a06c-4e6f-bd5c-3f4467d4356a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:10.927791 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3818c64-a06c-4e6f-bd5c-3f4467d4356a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:10.941451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.wsgi [None req-a3818c64-a06c-4e6f-bd5c-3f4467d4356a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] HTTP exception thrown: Instance fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b could not be found. Apr 12 15:02:10.942941 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a3818c64-a06c-4e6f-bd5c-3f4467d4356a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] Returning 404 to user: Instance fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b could not be found. {{(pid=124199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:02:10.943477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a3818c64-a06c-4e6f-bd5c-3f4467d4356a tempest-VolumesActionsTest-2104695101 tempest-VolumesActionsTest-2104695101-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b" status: 404 len: 111 microversion: 2.1 time: 0.033462 Apr 12 15:02:10.944120 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 481/938] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:10 2022] GET /compute/v2.1/servers/fa0ce2a3-cbe2-4350-af5e-8b6a33384a9b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:02:13.242969 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-18052146-7acd-4014-a71e-5c292974e04b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:13.244044 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-18052146-7acd-4014-a71e-5c292974e04b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:13.246346 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-bde1a1dc-8fdb-46bb-9cdd-11ac8c281791 req-40868f4b-8517-49f7-b98f-8a960b006d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e688875-ca8d-4972-9d02-9c66a8634013", "tag": "1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:02:13.251072 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18052146-7acd-4014-a71e-5c292974e04b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:13.251460 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18052146-7acd-4014-a71e-5c292974e04b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:13.252247 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18052146-7acd-4014-a71e-5c292974e04b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:13.252869 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-18052146-7acd-4014-a71e-5c292974e04b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:13.259343 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-bde1a1dc-8fdb-46bb-9cdd-11ac8c281791 req-40868f4b-8517-49f7-b98f-8a960b006d1c service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:13.260124 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-bde1a1dc-8fdb-46bb-9cdd-11ac8c281791 req-40868f4b-8517-49f7-b98f-8a960b006d1c service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:13.274601 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-bde1a1dc-8fdb-46bb-9cdd-11ac8c281791 req-40868f4b-8517-49f7-b98f-8a960b006d1c service nova] Creating event network-changed:1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe for instance 7e688875-ca8d-4972-9d02-9c66a8634013 on hv-cinder-83752 Apr 12 15:02:13.279854 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-bde1a1dc-8fdb-46bb-9cdd-11ac8c281791 req-40868f4b-8517-49f7-b98f-8a960b006d1c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037189 Apr 12 15:02:13.280534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 482/939] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 15:02:13.282846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-18052146-7acd-4014-a71e-5c292974e04b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 15:02:13.695594 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-18052146-7acd-4014-a71e-5c292974e04b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 204 len: 0 microversion: 2.1 time: 0.457084 Apr 12 15:02:13.696228 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 458/940] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:02:13 2022] DELETE /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 15:02:13.705049 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-63438591-f4d0-408b-b25a-c3b414a698db tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:13.708259 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-63438591-f4d0-408b-b25a-c3b414a698db tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:13.713242 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63438591-f4d0-408b-b25a-c3b414a698db tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:13.713692 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63438591-f4d0-408b-b25a-c3b414a698db tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:13.714617 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63438591-f4d0-408b-b25a-c3b414a698db tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:13.715236 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-63438591-f4d0-408b-b25a-c3b414a698db tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:13.886189 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-63438591-f4d0-408b-b25a-c3b414a698db tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:13.894640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-63438591-f4d0-408b-b25a-c3b414a698db tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.193685 Apr 12 15:02:13.895241 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 483/941] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:13 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:14.913764 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-22386c68-8cf8-4ad7-b282-015b74fe8aa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:14.914635 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-22386c68-8cf8-4ad7-b282-015b74fe8aa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:14.921173 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-22386c68-8cf8-4ad7-b282-015b74fe8aa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:14.921619 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-22386c68-8cf8-4ad7-b282-015b74fe8aa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:14.922472 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-22386c68-8cf8-4ad7-b282-015b74fe8aa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:14.922900 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-22386c68-8cf8-4ad7-b282-015b74fe8aa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:15.062000 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-22386c68-8cf8-4ad7-b282-015b74fe8aa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:15.070340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-22386c68-8cf8-4ad7-b282-015b74fe8aa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.161708 Apr 12 15:02:15.070906 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 459/942] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:14 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:16.090108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d246f4d6-958a-4fce-850a-eebe375cf965 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:16.090108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d246f4d6-958a-4fce-850a-eebe375cf965 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:16.096879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d246f4d6-958a-4fce-850a-eebe375cf965 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:16.097397 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d246f4d6-958a-4fce-850a-eebe375cf965 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:16.098923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d246f4d6-958a-4fce-850a-eebe375cf965 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:16.099700 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d246f4d6-958a-4fce-850a-eebe375cf965 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:16.237503 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d246f4d6-958a-4fce-850a-eebe375cf965 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:16.245052 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d246f4d6-958a-4fce-850a-eebe375cf965 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.160175 Apr 12 15:02:16.245609 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 484/943] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:16 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:17.265012 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1a733eda-34cd-4852-afb1-17f89f9a8236 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:17.265618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1a733eda-34cd-4852-afb1-17f89f9a8236 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:17.272122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a733eda-34cd-4852-afb1-17f89f9a8236 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:17.272573 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a733eda-34cd-4852-afb1-17f89f9a8236 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:17.273361 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a733eda-34cd-4852-afb1-17f89f9a8236 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:17.273839 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1a733eda-34cd-4852-afb1-17f89f9a8236 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:17.431427 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1a733eda-34cd-4852-afb1-17f89f9a8236 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:17.441699 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1a733eda-34cd-4852-afb1-17f89f9a8236 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1568 microversion: 2.1 time: 0.180618 Apr 12 15:02:17.442797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 460/944] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:17 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:18.459117 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e7dab60c-cea0-4912-9c41-159624288b1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:18.459836 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e7dab60c-cea0-4912-9c41-159624288b1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:18.466234 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7dab60c-cea0-4912-9c41-159624288b1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:18.466684 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7dab60c-cea0-4912-9c41-159624288b1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:18.467443 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7dab60c-cea0-4912-9c41-159624288b1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:18.467875 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7dab60c-cea0-4912-9c41-159624288b1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:18.600765 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e7dab60c-cea0-4912-9c41-159624288b1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:18.608720 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e7dab60c-cea0-4912-9c41-159624288b1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.153477 Apr 12 15:02:18.609304 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 485/945] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:18 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:19.626614 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9f1f5a28-79cd-4412-8fcb-a52dcec45c39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:19.627225 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9f1f5a28-79cd-4412-8fcb-a52dcec45c39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:19.633692 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9f1f5a28-79cd-4412-8fcb-a52dcec45c39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:19.635552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9f1f5a28-79cd-4412-8fcb-a52dcec45c39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:19.635552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9f1f5a28-79cd-4412-8fcb-a52dcec45c39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:19.635552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9f1f5a28-79cd-4412-8fcb-a52dcec45c39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:19.770137 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9f1f5a28-79cd-4412-8fcb-a52dcec45c39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:19.778434 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9f1f5a28-79cd-4412-8fcb-a52dcec45c39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.155745 Apr 12 15:02:19.779013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 461/946] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:19 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:20.796398 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-54f87f8f-b683-4745-a24d-03f3e0bc051c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:20.797038 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-54f87f8f-b683-4745-a24d-03f3e0bc051c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:20.803706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54f87f8f-b683-4745-a24d-03f3e0bc051c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:20.804142 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54f87f8f-b683-4745-a24d-03f3e0bc051c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:20.804902 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54f87f8f-b683-4745-a24d-03f3e0bc051c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:20.805328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-54f87f8f-b683-4745-a24d-03f3e0bc051c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:20.938934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-54f87f8f-b683-4745-a24d-03f3e0bc051c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:20.948294 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-54f87f8f-b683-4745-a24d-03f3e0bc051c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.155913 Apr 12 15:02:20.948849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 486/947] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:20 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:21.623794 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-a89c05e0-ccd2-460b-8399-cccb5ce868b6 req-dea25e9f-f4d5-4673-9c51-658a0789c494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e688875-ca8d-4972-9d02-9c66a8634013", "name": "network-vif-unplugged", "status": "completed", "tag": "1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:02:21.632950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-a89c05e0-ccd2-460b-8399-cccb5ce868b6 req-dea25e9f-f4d5-4673-9c51-658a0789c494 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:21.632950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-a89c05e0-ccd2-460b-8399-cccb5ce868b6 req-dea25e9f-f4d5-4673-9c51-658a0789c494 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:21.645480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-a89c05e0-ccd2-460b-8399-cccb5ce868b6 req-dea25e9f-f4d5-4673-9c51-658a0789c494 service nova] Creating event network-vif-unplugged:1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe for instance 7e688875-ca8d-4972-9d02-9c66a8634013 on hv-cinder-83752 Apr 12 15:02:21.650468 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-a89c05e0-ccd2-460b-8399-cccb5ce868b6 req-dea25e9f-f4d5-4673-9c51-658a0789c494 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030355 Apr 12 15:02:21.651070 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 462/948] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:02:21.966074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c07d3c07-de77-43f5-b22f-43463d82bca9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:21.966738 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c07d3c07-de77-43f5-b22f-43463d82bca9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:21.973162 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c07d3c07-de77-43f5-b22f-43463d82bca9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:21.973602 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c07d3c07-de77-43f5-b22f-43463d82bca9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:21.975200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c07d3c07-de77-43f5-b22f-43463d82bca9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:21.975630 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c07d3c07-de77-43f5-b22f-43463d82bca9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:22.106147 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c07d3c07-de77-43f5-b22f-43463d82bca9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:22.113510 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c07d3c07-de77-43f5-b22f-43463d82bca9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.151363 Apr 12 15:02:22.114252 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 487/949] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:21 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:23.131665 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3990edca-c904-4507-b240-5748f632917f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:23.132399 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3990edca-c904-4507-b240-5748f632917f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:23.138470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3990edca-c904-4507-b240-5748f632917f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:23.138906 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3990edca-c904-4507-b240-5748f632917f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:23.139652 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3990edca-c904-4507-b240-5748f632917f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:23.140078 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3990edca-c904-4507-b240-5748f632917f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:23.273992 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3990edca-c904-4507-b240-5748f632917f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:23.281343 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3990edca-c904-4507-b240-5748f632917f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.154274 Apr 12 15:02:23.281942 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 463/950] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:23 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:24.299270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c30f232e-f276-4229-b88d-3da480e936eb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:24.299902 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c30f232e-f276-4229-b88d-3da480e936eb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:24.306513 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c30f232e-f276-4229-b88d-3da480e936eb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:24.306950 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c30f232e-f276-4229-b88d-3da480e936eb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:24.307714 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c30f232e-f276-4229-b88d-3da480e936eb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:24.308162 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c30f232e-f276-4229-b88d-3da480e936eb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:24.436935 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c30f232e-f276-4229-b88d-3da480e936eb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:24.444649 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c30f232e-f276-4229-b88d-3da480e936eb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.149270 Apr 12 15:02:24.445961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 488/951] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:24 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:25.463175 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c1c5e7d2-646d-4a37-b2fd-30d68c0a4d13 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:25.464019 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c1c5e7d2-646d-4a37-b2fd-30d68c0a4d13 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:25.470413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1c5e7d2-646d-4a37-b2fd-30d68c0a4d13 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:25.470862 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1c5e7d2-646d-4a37-b2fd-30d68c0a4d13 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:25.471630 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1c5e7d2-646d-4a37-b2fd-30d68c0a4d13 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:25.472063 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1c5e7d2-646d-4a37-b2fd-30d68c0a4d13 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:25.609936 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c1c5e7d2-646d-4a37-b2fd-30d68c0a4d13 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:25.617937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c1c5e7d2-646d-4a37-b2fd-30d68c0a4d13 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.159263 Apr 12 15:02:25.625238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 464/952] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:25 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:26.928759 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7b75ccbb-e380-4c21-8330-aab422afafc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:26.929367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7b75ccbb-e380-4c21-8330-aab422afafc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:26.935204 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7b75ccbb-e380-4c21-8330-aab422afafc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:26.935650 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7b75ccbb-e380-4c21-8330-aab422afafc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:26.936415 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7b75ccbb-e380-4c21-8330-aab422afafc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:26.936845 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7b75ccbb-e380-4c21-8330-aab422afafc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:27.066320 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7b75ccbb-e380-4c21-8330-aab422afafc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:27.074606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7b75ccbb-e380-4c21-8330-aab422afafc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.438042 Apr 12 15:02:27.075194 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 489/953] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:26 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:28.092339 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b2426a87-e6f4-43ff-bb28-935ed08af42d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:28.092971 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b2426a87-e6f4-43ff-bb28-935ed08af42d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:28.099368 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b2426a87-e6f4-43ff-bb28-935ed08af42d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:28.099822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b2426a87-e6f4-43ff-bb28-935ed08af42d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:28.100590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b2426a87-e6f4-43ff-bb28-935ed08af42d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:28.101032 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b2426a87-e6f4-43ff-bb28-935ed08af42d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:28.232482 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b2426a87-e6f4-43ff-bb28-935ed08af42d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:28.240032 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b2426a87-e6f4-43ff-bb28-935ed08af42d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.152485 Apr 12 15:02:28.240649 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 465/954] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:28 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:29.257568 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b120bd76-08ba-48c1-90bc-70ead7bfad0c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:29.258192 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b120bd76-08ba-48c1-90bc-70ead7bfad0c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:29.265176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b120bd76-08ba-48c1-90bc-70ead7bfad0c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:29.265624 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b120bd76-08ba-48c1-90bc-70ead7bfad0c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:29.266410 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b120bd76-08ba-48c1-90bc-70ead7bfad0c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:29.266836 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b120bd76-08ba-48c1-90bc-70ead7bfad0c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:29.394588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b120bd76-08ba-48c1-90bc-70ead7bfad0c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:29.402835 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b120bd76-08ba-48c1-90bc-70ead7bfad0c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.149591 Apr 12 15:02:29.403385 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 490/955] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:29 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:30.420403 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e8a6157f-bfa4-46b4-beaf-bd80127587bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:30.420937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e8a6157f-bfa4-46b4-beaf-bd80127587bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:30.427246 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e8a6157f-bfa4-46b4-beaf-bd80127587bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:30.427692 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e8a6157f-bfa4-46b4-beaf-bd80127587bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:30.428454 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e8a6157f-bfa4-46b4-beaf-bd80127587bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:30.428884 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e8a6157f-bfa4-46b4-beaf-bd80127587bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:30.561735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e8a6157f-bfa4-46b4-beaf-bd80127587bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:30.569434 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e8a6157f-bfa4-46b4-beaf-bd80127587bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.153082 Apr 12 15:02:30.570020 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 466/956] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:30 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:31.586654 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f5159e87-0ee8-48d2-8b57-11b3c1a603b9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:31.587298 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f5159e87-0ee8-48d2-8b57-11b3c1a603b9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:31.594087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5159e87-0ee8-48d2-8b57-11b3c1a603b9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:31.594531 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5159e87-0ee8-48d2-8b57-11b3c1a603b9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:31.595301 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5159e87-0ee8-48d2-8b57-11b3c1a603b9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:31.595737 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5159e87-0ee8-48d2-8b57-11b3c1a603b9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:31.727566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f5159e87-0ee8-48d2-8b57-11b3c1a603b9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:31.735592 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f5159e87-0ee8-48d2-8b57-11b3c1a603b9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.152744 Apr 12 15:02:31.736156 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 491/957] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:31 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:32.752500 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3869de85-bd89-4b7b-8e82-84f8ba3c6eac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:32.753096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3869de85-bd89-4b7b-8e82-84f8ba3c6eac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:32.759611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3869de85-bd89-4b7b-8e82-84f8ba3c6eac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:32.764507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3869de85-bd89-4b7b-8e82-84f8ba3c6eac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:32.764507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3869de85-bd89-4b7b-8e82-84f8ba3c6eac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:32.764507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3869de85-bd89-4b7b-8e82-84f8ba3c6eac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:32.894082 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3869de85-bd89-4b7b-8e82-84f8ba3c6eac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:32.901787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3869de85-bd89-4b7b-8e82-84f8ba3c6eac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.153320 Apr 12 15:02:32.902365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 467/958] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:32 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:33.919852 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-76b13cad-fce6-4505-a214-cbdf6a25d351 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:33.920475 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-76b13cad-fce6-4505-a214-cbdf6a25d351 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:33.926840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76b13cad-fce6-4505-a214-cbdf6a25d351 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:33.927280 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76b13cad-fce6-4505-a214-cbdf6a25d351 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:33.928044 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76b13cad-fce6-4505-a214-cbdf6a25d351 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:33.928479 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-76b13cad-fce6-4505-a214-cbdf6a25d351 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:34.072123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-76b13cad-fce6-4505-a214-cbdf6a25d351 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:34.079617 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-76b13cad-fce6-4505-a214-cbdf6a25d351 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.164850 Apr 12 15:02:34.080182 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 492/959] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:33 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:35.097448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-71e97dfe-0537-4eb4-b8f8-8b2a5a71deac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:35.098061 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-71e97dfe-0537-4eb4-b8f8-8b2a5a71deac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:35.105217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-71e97dfe-0537-4eb4-b8f8-8b2a5a71deac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:35.106173 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-71e97dfe-0537-4eb4-b8f8-8b2a5a71deac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:35.106987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-71e97dfe-0537-4eb4-b8f8-8b2a5a71deac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:35.107417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-71e97dfe-0537-4eb4-b8f8-8b2a5a71deac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:35.241093 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-71e97dfe-0537-4eb4-b8f8-8b2a5a71deac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:35.249374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-71e97dfe-0537-4eb4-b8f8-8b2a5a71deac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.156679 Apr 12 15:02:35.249967 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 468/960] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:35 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:02:36.266736 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-536d0417-95dd-4cf1-89c4-6f9217abc61b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:36.267345 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-536d0417-95dd-4cf1-89c4-6f9217abc61b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:36.273785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-536d0417-95dd-4cf1-89c4-6f9217abc61b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:36.274238 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-536d0417-95dd-4cf1-89c4-6f9217abc61b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:36.275004 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-536d0417-95dd-4cf1-89c4-6f9217abc61b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:36.275437 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-536d0417-95dd-4cf1-89c4-6f9217abc61b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:36.406639 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-536d0417-95dd-4cf1-89c4-6f9217abc61b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:36.414165 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-536d0417-95dd-4cf1-89c4-6f9217abc61b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.151324 Apr 12 15:02:36.414719 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 493/961] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:36 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:37.431616 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6390246e-06ef-4e4c-a454-fe9e66f6c70e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:37.433005 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6390246e-06ef-4e4c-a454-fe9e66f6c70e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:37.438842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6390246e-06ef-4e4c-a454-fe9e66f6c70e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:37.439290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6390246e-06ef-4e4c-a454-fe9e66f6c70e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:37.440054 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6390246e-06ef-4e4c-a454-fe9e66f6c70e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:37.440489 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6390246e-06ef-4e4c-a454-fe9e66f6c70e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:37.572608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6390246e-06ef-4e4c-a454-fe9e66f6c70e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:37.579931 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6390246e-06ef-4e4c-a454-fe9e66f6c70e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.152319 Apr 12 15:02:37.580504 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 469/962] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:37 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:38.597673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ca589471-9b70-45c4-8d40-9210bdb17f38 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:38.598283 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ca589471-9b70-45c4-8d40-9210bdb17f38 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:38.604628 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca589471-9b70-45c4-8d40-9210bdb17f38 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:38.605622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca589471-9b70-45c4-8d40-9210bdb17f38 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:38.606607 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca589471-9b70-45c4-8d40-9210bdb17f38 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:38.607176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca589471-9b70-45c4-8d40-9210bdb17f38 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:38.746792 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ca589471-9b70-45c4-8d40-9210bdb17f38 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:38.754835 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ca589471-9b70-45c4-8d40-9210bdb17f38 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.160994 Apr 12 15:02:38.757386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 494/963] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:38 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:39.772787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-db848c40-1d00-46fc-8d5f-e93754c28638 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:39.773399 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-db848c40-1d00-46fc-8d5f-e93754c28638 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:39.779848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db848c40-1d00-46fc-8d5f-e93754c28638 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:39.780298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db848c40-1d00-46fc-8d5f-e93754c28638 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:39.781068 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db848c40-1d00-46fc-8d5f-e93754c28638 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:39.781503 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db848c40-1d00-46fc-8d5f-e93754c28638 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:39.911165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-db848c40-1d00-46fc-8d5f-e93754c28638 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:39.919245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-db848c40-1d00-46fc-8d5f-e93754c28638 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.150518 Apr 12 15:02:39.919816 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 470/964] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:39 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:40.937317 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-025acb31-203f-490f-8a4a-63e9c34d6364 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:40.937956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-025acb31-203f-490f-8a4a-63e9c34d6364 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:40.944411 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-025acb31-203f-490f-8a4a-63e9c34d6364 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:40.944852 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-025acb31-203f-490f-8a4a-63e9c34d6364 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:40.945602 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-025acb31-203f-490f-8a4a-63e9c34d6364 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:40.946049 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-025acb31-203f-490f-8a4a-63e9c34d6364 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:41.087896 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-025acb31-203f-490f-8a4a-63e9c34d6364 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:41.095416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-025acb31-203f-490f-8a4a-63e9c34d6364 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.162854 Apr 12 15:02:41.095987 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 495/965] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:40 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:42.112804 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-42aa05a8-96f7-407a-911b-0a670c1ecea4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:42.113504 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-42aa05a8-96f7-407a-911b-0a670c1ecea4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:42.120004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42aa05a8-96f7-407a-911b-0a670c1ecea4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:42.120454 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42aa05a8-96f7-407a-911b-0a670c1ecea4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:42.121872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42aa05a8-96f7-407a-911b-0a670c1ecea4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:42.122353 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-42aa05a8-96f7-407a-911b-0a670c1ecea4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:42.252613 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-42aa05a8-96f7-407a-911b-0a670c1ecea4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:42.260493 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-42aa05a8-96f7-407a-911b-0a670c1ecea4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.151751 Apr 12 15:02:42.261110 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 471/966] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:42 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:43.278142 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-43207064-8f7f-4bb8-a016-df4cc831dab2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:43.278920 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-43207064-8f7f-4bb8-a016-df4cc831dab2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:43.286003 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43207064-8f7f-4bb8-a016-df4cc831dab2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:43.286512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43207064-8f7f-4bb8-a016-df4cc831dab2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:43.287311 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43207064-8f7f-4bb8-a016-df4cc831dab2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:43.287740 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-43207064-8f7f-4bb8-a016-df4cc831dab2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:43.417788 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-43207064-8f7f-4bb8-a016-df4cc831dab2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:43.426039 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-43207064-8f7f-4bb8-a016-df4cc831dab2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.152055 Apr 12 15:02:43.432321 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 496/967] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:43 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:44.443576 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f74ea8be-c640-4e02-bc0c-d79e9a0c2120 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:44.444104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f74ea8be-c640-4e02-bc0c-d79e9a0c2120 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:44.450527 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f74ea8be-c640-4e02-bc0c-d79e9a0c2120 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:44.450975 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f74ea8be-c640-4e02-bc0c-d79e9a0c2120 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:44.451798 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f74ea8be-c640-4e02-bc0c-d79e9a0c2120 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:44.452224 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f74ea8be-c640-4e02-bc0c-d79e9a0c2120 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:44.584271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f74ea8be-c640-4e02-bc0c-d79e9a0c2120 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:44.591624 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f74ea8be-c640-4e02-bc0c-d79e9a0c2120 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.152297 Apr 12 15:02:44.592811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 472/968] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:44 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:45.608916 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1c558ea6-127d-4247-85f1-7fd3696e351b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:45.609523 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1c558ea6-127d-4247-85f1-7fd3696e351b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:45.615816 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c558ea6-127d-4247-85f1-7fd3696e351b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:45.616263 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c558ea6-127d-4247-85f1-7fd3696e351b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:45.617027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c558ea6-127d-4247-85f1-7fd3696e351b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:45.617646 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c558ea6-127d-4247-85f1-7fd3696e351b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:45.749881 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1c558ea6-127d-4247-85f1-7fd3696e351b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:45.757261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1c558ea6-127d-4247-85f1-7fd3696e351b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.152308 Apr 12 15:02:45.757865 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 497/969] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:45 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:46.777861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-957f6708-b756-4ecd-a65c-9c333867c0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:46.778942 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-957f6708-b756-4ecd-a65c-9c333867c0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:46.787894 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-957f6708-b756-4ecd-a65c-9c333867c0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:46.787894 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-957f6708-b756-4ecd-a65c-9c333867c0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:46.788219 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-957f6708-b756-4ecd-a65c-9c333867c0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:46.788652 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-957f6708-b756-4ecd-a65c-9c333867c0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:46.915623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-957f6708-b756-4ecd-a65c-9c333867c0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:46.923155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-957f6708-b756-4ecd-a65c-9c333867c0e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.151687 Apr 12 15:02:46.923723 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 473/970] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:46 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:47.941148 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4f8377d7-5135-4188-8117-1625f4564854 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:47.941837 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4f8377d7-5135-4188-8117-1625f4564854 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:47.948043 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4f8377d7-5135-4188-8117-1625f4564854 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:47.948485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4f8377d7-5135-4188-8117-1625f4564854 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:47.949249 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4f8377d7-5135-4188-8117-1625f4564854 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:47.949704 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4f8377d7-5135-4188-8117-1625f4564854 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:48.087699 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4f8377d7-5135-4188-8117-1625f4564854 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:48.095790 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4f8377d7-5135-4188-8117-1625f4564854 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.159507 Apr 12 15:02:48.096357 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 498/971] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:47 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:49.113491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-00476a05-1c29-4d34-b085-0551aff4df24 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:49.114100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-00476a05-1c29-4d34-b085-0551aff4df24 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:49.120320 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-00476a05-1c29-4d34-b085-0551aff4df24 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:49.120762 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-00476a05-1c29-4d34-b085-0551aff4df24 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:49.121516 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-00476a05-1c29-4d34-b085-0551aff4df24 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:49.121969 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-00476a05-1c29-4d34-b085-0551aff4df24 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:49.250559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-00476a05-1c29-4d34-b085-0551aff4df24 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:49.259182 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-00476a05-1c29-4d34-b085-0551aff4df24 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.149513 Apr 12 15:02:49.259735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 474/972] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:49 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:50.276208 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d25f2af9-2f76-476b-9bb4-20d020e8ec74 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:50.276812 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d25f2af9-2f76-476b-9bb4-20d020e8ec74 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:50.283889 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d25f2af9-2f76-476b-9bb4-20d020e8ec74 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:50.284441 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d25f2af9-2f76-476b-9bb4-20d020e8ec74 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:50.285350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d25f2af9-2f76-476b-9bb4-20d020e8ec74 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:50.285854 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d25f2af9-2f76-476b-9bb4-20d020e8ec74 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:50.412158 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d25f2af9-2f76-476b-9bb4-20d020e8ec74 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:50.419501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d25f2af9-2f76-476b-9bb4-20d020e8ec74 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.147270 Apr 12 15:02:50.420053 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 499/973] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:50 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:51.435903 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0f176ad4-4382-47f6-ab1b-4f8e56a717a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:51.436503 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0f176ad4-4382-47f6-ab1b-4f8e56a717a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:51.443485 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0f176ad4-4382-47f6-ab1b-4f8e56a717a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:51.443928 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0f176ad4-4382-47f6-ab1b-4f8e56a717a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:51.444689 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0f176ad4-4382-47f6-ab1b-4f8e56a717a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:51.445114 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0f176ad4-4382-47f6-ab1b-4f8e56a717a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:51.581178 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0f176ad4-4382-47f6-ab1b-4f8e56a717a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:51.589233 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0f176ad4-4382-47f6-ab1b-4f8e56a717a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.157040 Apr 12 15:02:51.589784 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 475/974] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:51 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:52.606936 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5b01e3a4-e2ed-4fa2-88c0-3fe8fe518d5e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:52.607547 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5b01e3a4-e2ed-4fa2-88c0-3fe8fe518d5e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:52.614391 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b01e3a4-e2ed-4fa2-88c0-3fe8fe518d5e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:52.614835 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b01e3a4-e2ed-4fa2-88c0-3fe8fe518d5e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:52.615723 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b01e3a4-e2ed-4fa2-88c0-3fe8fe518d5e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:52.616148 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b01e3a4-e2ed-4fa2-88c0-3fe8fe518d5e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:52.758191 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5b01e3a4-e2ed-4fa2-88c0-3fe8fe518d5e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:52.758191 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5b01e3a4-e2ed-4fa2-88c0-3fe8fe518d5e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.152489 Apr 12 15:02:52.758191 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 500/975] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:52 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:53.773942 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-adca3199-8416-4947-8fbe-47482e2efad8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:53.774612 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-adca3199-8416-4947-8fbe-47482e2efad8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:53.781073 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-adca3199-8416-4947-8fbe-47482e2efad8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:53.781521 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-adca3199-8416-4947-8fbe-47482e2efad8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:53.782397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-adca3199-8416-4947-8fbe-47482e2efad8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:53.782839 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-adca3199-8416-4947-8fbe-47482e2efad8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:53.918484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-adca3199-8416-4947-8fbe-47482e2efad8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:53.926965 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-adca3199-8416-4947-8fbe-47482e2efad8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.156963 Apr 12 15:02:53.927533 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 476/976] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:53 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:54.944840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-469755c5-6b39-4edb-af46-16a1861a4b21 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:54.945438 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-469755c5-6b39-4edb-af46-16a1861a4b21 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:54.951686 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-469755c5-6b39-4edb-af46-16a1861a4b21 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:54.952129 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-469755c5-6b39-4edb-af46-16a1861a4b21 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:54.952893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-469755c5-6b39-4edb-af46-16a1861a4b21 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:54.953317 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-469755c5-6b39-4edb-af46-16a1861a4b21 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:55.082479 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-469755c5-6b39-4edb-af46-16a1861a4b21 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:55.089725 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-469755c5-6b39-4edb-af46-16a1861a4b21 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.149329 Apr 12 15:02:55.090284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 501/977] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:54 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:56.108980 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-abac02cd-bf54-4918-929d-e6449fc74ef8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:56.110095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-abac02cd-bf54-4918-929d-e6449fc74ef8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:56.118432 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abac02cd-bf54-4918-929d-e6449fc74ef8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:56.118882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abac02cd-bf54-4918-929d-e6449fc74ef8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:56.119658 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abac02cd-bf54-4918-929d-e6449fc74ef8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:56.120092 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-abac02cd-bf54-4918-929d-e6449fc74ef8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:56.277300 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-abac02cd-bf54-4918-929d-e6449fc74ef8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:56.285464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-abac02cd-bf54-4918-929d-e6449fc74ef8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.181931 Apr 12 15:02:56.286114 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 477/978] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:56 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:57.304081 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b84d3325-48af-4a85-a98b-9422a83f40ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:57.304756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b84d3325-48af-4a85-a98b-9422a83f40ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:57.311358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b84d3325-48af-4a85-a98b-9422a83f40ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:57.311798 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b84d3325-48af-4a85-a98b-9422a83f40ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:57.312559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b84d3325-48af-4a85-a98b-9422a83f40ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:57.312983 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b84d3325-48af-4a85-a98b-9422a83f40ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:57.441807 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b84d3325-48af-4a85-a98b-9422a83f40ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:57.449415 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b84d3325-48af-4a85-a98b-9422a83f40ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.149080 Apr 12 15:02:57.449993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 502/979] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:57 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:58.466124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7978a5db-913f-4068-8e51-8f20ce8ef2a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:58.466730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7978a5db-913f-4068-8e51-8f20ce8ef2a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:58.473664 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7978a5db-913f-4068-8e51-8f20ce8ef2a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:58.474129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7978a5db-913f-4068-8e51-8f20ce8ef2a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:58.474896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7978a5db-913f-4068-8e51-8f20ce8ef2a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:58.475376 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7978a5db-913f-4068-8e51-8f20ce8ef2a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:58.605346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7978a5db-913f-4068-8e51-8f20ce8ef2a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:58.612753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7978a5db-913f-4068-8e51-8f20ce8ef2a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.150429 Apr 12 15:02:58.613393 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 478/980] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:58 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:02:59.629582 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2a3636f3-f503-4a17-bed1-462aa34aa768 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:02:59.632242 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2a3636f3-f503-4a17-bed1-462aa34aa768 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:02:59.636477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a3636f3-f503-4a17-bed1-462aa34aa768 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:59.636925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a3636f3-f503-4a17-bed1-462aa34aa768 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:59.637713 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a3636f3-f503-4a17-bed1-462aa34aa768 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:02:59.638144 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a3636f3-f503-4a17-bed1-462aa34aa768 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:02:59.769541 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2a3636f3-f503-4a17-bed1-462aa34aa768 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:02:59.776876 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2a3636f3-f503-4a17-bed1-462aa34aa768 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.151211 Apr 12 15:02:59.777435 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 503/981] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:02:59 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:00.794675 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6c742fc8-f64d-4ebd-9d32-5c2846c2da59 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:00.795240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6c742fc8-f64d-4ebd-9d32-5c2846c2da59 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:00.802559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c742fc8-f64d-4ebd-9d32-5c2846c2da59 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:00.803001 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c742fc8-f64d-4ebd-9d32-5c2846c2da59 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:00.803761 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c742fc8-f64d-4ebd-9d32-5c2846c2da59 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:00.804190 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c742fc8-f64d-4ebd-9d32-5c2846c2da59 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:00.948677 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6c742fc8-f64d-4ebd-9d32-5c2846c2da59 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:00.957015 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6c742fc8-f64d-4ebd-9d32-5c2846c2da59 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.166425 Apr 12 15:03:00.966076 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 479/982] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:00 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:01.974482 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-eaf0abe6-f5f5-43c6-b87e-c0eb00770ea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:01.975085 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-eaf0abe6-f5f5-43c6-b87e-c0eb00770ea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:01.981368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eaf0abe6-f5f5-43c6-b87e-c0eb00770ea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:01.981851 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eaf0abe6-f5f5-43c6-b87e-c0eb00770ea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:01.982606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eaf0abe6-f5f5-43c6-b87e-c0eb00770ea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:01.983033 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eaf0abe6-f5f5-43c6-b87e-c0eb00770ea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:02.114994 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-eaf0abe6-f5f5-43c6-b87e-c0eb00770ea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:02.122565 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-eaf0abe6-f5f5-43c6-b87e-c0eb00770ea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.152607 Apr 12 15:03:02.123141 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 504/983] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:01 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:03.140320 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-665868fe-7c40-4bd7-a986-7f1d5566ee8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:03.140922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-665868fe-7c40-4bd7-a986-7f1d5566ee8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:03.147818 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-665868fe-7c40-4bd7-a986-7f1d5566ee8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:03.148266 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-665868fe-7c40-4bd7-a986-7f1d5566ee8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:03.149028 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-665868fe-7c40-4bd7-a986-7f1d5566ee8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:03.149459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-665868fe-7c40-4bd7-a986-7f1d5566ee8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:03.282664 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-665868fe-7c40-4bd7-a986-7f1d5566ee8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:03.289359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-665868fe-7c40-4bd7-a986-7f1d5566ee8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.152854 Apr 12 15:03:03.289990 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 480/984] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:03 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:04.307085 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9eaaf919-d82a-4b58-b1a2-12d03554a6f0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:04.307672 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9eaaf919-d82a-4b58-b1a2-12d03554a6f0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:04.313982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9eaaf919-d82a-4b58-b1a2-12d03554a6f0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:04.314460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9eaaf919-d82a-4b58-b1a2-12d03554a6f0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:04.315217 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9eaaf919-d82a-4b58-b1a2-12d03554a6f0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:04.315910 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9eaaf919-d82a-4b58-b1a2-12d03554a6f0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:04.445440 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9eaaf919-d82a-4b58-b1a2-12d03554a6f0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:04.452705 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9eaaf919-d82a-4b58-b1a2-12d03554a6f0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.149495 Apr 12 15:03:04.453267 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 505/985] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:04 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:05.469275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-782129b4-1332-41b3-b8b4-a72aa1b3ed1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:05.469915 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-782129b4-1332-41b3-b8b4-a72aa1b3ed1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:05.476277 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-782129b4-1332-41b3-b8b4-a72aa1b3ed1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:05.476719 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-782129b4-1332-41b3-b8b4-a72aa1b3ed1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:05.477480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-782129b4-1332-41b3-b8b4-a72aa1b3ed1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:05.477943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-782129b4-1332-41b3-b8b4-a72aa1b3ed1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:05.631495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-782129b4-1332-41b3-b8b4-a72aa1b3ed1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:05.639227 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-782129b4-1332-41b3-b8b4-a72aa1b3ed1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1450 microversion: 2.1 time: 0.173930 Apr 12 15:03:05.639941 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 481/986] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:05 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:06.483036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-df75aca5-43bc-409b-b07e-9e94e5dd2c5b req-3eda498f-60cf-4dce-845a-8a19146fc044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e688875-ca8d-4972-9d02-9c66a8634013", "name": "network-vif-deleted", "tag": "1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:03:06.492137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-df75aca5-43bc-409b-b07e-9e94e5dd2c5b req-3eda498f-60cf-4dce-845a-8a19146fc044 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:06.492576 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-df75aca5-43bc-409b-b07e-9e94e5dd2c5b req-3eda498f-60cf-4dce-845a-8a19146fc044 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:06.503370 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-df75aca5-43bc-409b-b07e-9e94e5dd2c5b req-3eda498f-60cf-4dce-845a-8a19146fc044 service nova] Creating event network-vif-deleted:1df78fb3-8e3e-4e74-a357-5ddb8e78c3fe for instance 7e688875-ca8d-4972-9d02-9c66a8634013 on hv-cinder-83752 Apr 12 15:03:06.508488 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-df75aca5-43bc-409b-b07e-9e94e5dd2c5b req-3eda498f-60cf-4dce-845a-8a19146fc044 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029107 Apr 12 15:03:06.509070 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 506/987] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:03:06.656154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-da7ad26c-7aae-4fc5-8c06-4896fd822759 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:06.660797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-da7ad26c-7aae-4fc5-8c06-4896fd822759 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:06.664159 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da7ad26c-7aae-4fc5-8c06-4896fd822759 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:06.664609 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da7ad26c-7aae-4fc5-8c06-4896fd822759 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:06.665380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da7ad26c-7aae-4fc5-8c06-4896fd822759 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:06.665864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da7ad26c-7aae-4fc5-8c06-4896fd822759 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:06.728006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-da7ad26c-7aae-4fc5-8c06-4896fd822759 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:06.735390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-da7ad26c-7aae-4fc5-8c06-4896fd822759 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083068 Apr 12 15:03:06.735945 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 482/988] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:06 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:07.752901 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-19fe7ff0-830d-4328-939b-2a73d4a76f2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:07.753614 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-19fe7ff0-830d-4328-939b-2a73d4a76f2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:07.760431 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19fe7ff0-830d-4328-939b-2a73d4a76f2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:07.760866 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19fe7ff0-830d-4328-939b-2a73d4a76f2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:07.761621 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19fe7ff0-830d-4328-939b-2a73d4a76f2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:07.762070 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19fe7ff0-830d-4328-939b-2a73d4a76f2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:07.823480 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-19fe7ff0-830d-4328-939b-2a73d4a76f2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:07.830880 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-19fe7ff0-830d-4328-939b-2a73d4a76f2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082576 Apr 12 15:03:07.831441 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 507/989] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:07 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:08.847861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-aa42f6e0-e3ca-4c04-902f-41a021260e25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:08.848453 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-aa42f6e0-e3ca-4c04-902f-41a021260e25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:08.854782 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa42f6e0-e3ca-4c04-902f-41a021260e25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:08.855233 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa42f6e0-e3ca-4c04-902f-41a021260e25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:08.855996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa42f6e0-e3ca-4c04-902f-41a021260e25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:08.856430 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa42f6e0-e3ca-4c04-902f-41a021260e25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:08.918057 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-aa42f6e0-e3ca-4c04-902f-41a021260e25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:08.925348 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-aa42f6e0-e3ca-4c04-902f-41a021260e25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081605 Apr 12 15:03:08.926470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 483/990] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:08 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:09.942982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-700ec2ec-58a1-4a93-b318-e01348c1b626 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:09.944182 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-700ec2ec-58a1-4a93-b318-e01348c1b626 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:09.950606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-700ec2ec-58a1-4a93-b318-e01348c1b626 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:09.951058 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-700ec2ec-58a1-4a93-b318-e01348c1b626 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:09.951850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-700ec2ec-58a1-4a93-b318-e01348c1b626 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:09.952284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-700ec2ec-58a1-4a93-b318-e01348c1b626 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:10.017333 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-700ec2ec-58a1-4a93-b318-e01348c1b626 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:10.025588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-700ec2ec-58a1-4a93-b318-e01348c1b626 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086733 Apr 12 15:03:10.026176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 508/991] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:09 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:11.043107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0b6ce22c-b9ea-4874-8cc3-572147c2c1ce tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:11.043747 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0b6ce22c-b9ea-4874-8cc3-572147c2c1ce tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:11.050471 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b6ce22c-b9ea-4874-8cc3-572147c2c1ce tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:11.050924 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b6ce22c-b9ea-4874-8cc3-572147c2c1ce tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:11.051738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b6ce22c-b9ea-4874-8cc3-572147c2c1ce tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:11.052180 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b6ce22c-b9ea-4874-8cc3-572147c2c1ce tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:11.118986 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0b6ce22c-b9ea-4874-8cc3-572147c2c1ce tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:11.126858 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0b6ce22c-b9ea-4874-8cc3-572147c2c1ce tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.087497 Apr 12 15:03:11.127450 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 484/992] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:11 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:12.144183 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6a7258f9-c1ef-4a80-a03d-99cf06a90ff4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:12.148712 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6a7258f9-c1ef-4a80-a03d-99cf06a90ff4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:12.151556 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6a7258f9-c1ef-4a80-a03d-99cf06a90ff4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:12.152000 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6a7258f9-c1ef-4a80-a03d-99cf06a90ff4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:12.152750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6a7258f9-c1ef-4a80-a03d-99cf06a90ff4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:12.153174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6a7258f9-c1ef-4a80-a03d-99cf06a90ff4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:12.213361 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6a7258f9-c1ef-4a80-a03d-99cf06a90ff4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:12.220842 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6a7258f9-c1ef-4a80-a03d-99cf06a90ff4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080461 Apr 12 15:03:12.221411 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 509/993] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:12 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:13.238969 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-500b5f26-3940-444a-bd66-3da467a9bfdf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:13.239632 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-500b5f26-3940-444a-bd66-3da467a9bfdf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:13.246389 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-500b5f26-3940-444a-bd66-3da467a9bfdf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:13.246830 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-500b5f26-3940-444a-bd66-3da467a9bfdf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:13.247927 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-500b5f26-3940-444a-bd66-3da467a9bfdf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:13.248360 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-500b5f26-3940-444a-bd66-3da467a9bfdf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:13.309853 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-500b5f26-3940-444a-bd66-3da467a9bfdf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:13.317452 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-500b5f26-3940-444a-bd66-3da467a9bfdf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082422 Apr 12 15:03:13.318042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 485/994] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:13 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:14.335062 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ab1415b5-9e2a-464d-be5e-9e414efa95d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:14.336321 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ab1415b5-9e2a-464d-be5e-9e414efa95d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:14.342767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab1415b5-9e2a-464d-be5e-9e414efa95d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:14.343212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab1415b5-9e2a-464d-be5e-9e414efa95d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:14.343978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab1415b5-9e2a-464d-be5e-9e414efa95d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:14.344408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ab1415b5-9e2a-464d-be5e-9e414efa95d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:14.406380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ab1415b5-9e2a-464d-be5e-9e414efa95d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:14.413986 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ab1415b5-9e2a-464d-be5e-9e414efa95d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083041 Apr 12 15:03:14.414549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 510/995] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:14 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:03:15.431059 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9d537d68-0d91-41fe-b7d6-afe11bd44d6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:15.431586 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9d537d68-0d91-41fe-b7d6-afe11bd44d6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:15.437964 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d537d68-0d91-41fe-b7d6-afe11bd44d6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:15.438414 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d537d68-0d91-41fe-b7d6-afe11bd44d6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:15.439210 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d537d68-0d91-41fe-b7d6-afe11bd44d6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:15.439651 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d537d68-0d91-41fe-b7d6-afe11bd44d6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:15.501529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9d537d68-0d91-41fe-b7d6-afe11bd44d6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:15.509006 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9d537d68-0d91-41fe-b7d6-afe11bd44d6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082145 Apr 12 15:03:15.509570 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 486/996] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:15 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:16.527125 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b9460d91-94a2-4b94-8729-14bc0c98c9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:16.527724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b9460d91-94a2-4b94-8729-14bc0c98c9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:16.534506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b9460d91-94a2-4b94-8729-14bc0c98c9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:16.534943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b9460d91-94a2-4b94-8729-14bc0c98c9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:16.535703 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b9460d91-94a2-4b94-8729-14bc0c98c9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:16.536181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b9460d91-94a2-4b94-8729-14bc0c98c9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:16.602157 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b9460d91-94a2-4b94-8729-14bc0c98c9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:16.609901 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b9460d91-94a2-4b94-8729-14bc0c98c9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.087757 Apr 12 15:03:16.610454 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 511/997] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:16 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:17.626904 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c08dec21-4685-4857-8e21-f4327210b816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:17.635282 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c08dec21-4685-4857-8e21-f4327210b816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:17.635282 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c08dec21-4685-4857-8e21-f4327210b816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:17.635282 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c08dec21-4685-4857-8e21-f4327210b816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:17.635282 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c08dec21-4685-4857-8e21-f4327210b816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:17.635649 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c08dec21-4685-4857-8e21-f4327210b816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:17.697325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c08dec21-4685-4857-8e21-f4327210b816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:17.704961 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c08dec21-4685-4857-8e21-f4327210b816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081926 Apr 12 15:03:17.705528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 487/998] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:17 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:18.722236 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3dee34b5-a3a9-4f1f-9277-38b7d6fc9afe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:18.722874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3dee34b5-a3a9-4f1f-9277-38b7d6fc9afe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:18.729278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3dee34b5-a3a9-4f1f-9277-38b7d6fc9afe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:18.729754 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3dee34b5-a3a9-4f1f-9277-38b7d6fc9afe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:18.731149 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3dee34b5-a3a9-4f1f-9277-38b7d6fc9afe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:18.731774 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3dee34b5-a3a9-4f1f-9277-38b7d6fc9afe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:18.798367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3dee34b5-a3a9-4f1f-9277-38b7d6fc9afe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:18.806971 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3dee34b5-a3a9-4f1f-9277-38b7d6fc9afe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.088597 Apr 12 15:03:18.807536 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 512/999] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:18 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:19.829970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0b74dbd9-c4f4-425b-9a82-4ff8fbd91fc9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:19.830443 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0b74dbd9-c4f4-425b-9a82-4ff8fbd91fc9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:19.836632 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b74dbd9-c4f4-425b-9a82-4ff8fbd91fc9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:19.837073 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b74dbd9-c4f4-425b-9a82-4ff8fbd91fc9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:19.837862 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b74dbd9-c4f4-425b-9a82-4ff8fbd91fc9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:19.838285 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0b74dbd9-c4f4-425b-9a82-4ff8fbd91fc9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:19.901664 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0b74dbd9-c4f4-425b-9a82-4ff8fbd91fc9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:19.909529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0b74dbd9-c4f4-425b-9a82-4ff8fbd91fc9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084196 Apr 12 15:03:19.910123 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 488/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:19 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:20.926768 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-10644fe2-c127-44de-9b10-f47bdf657c73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:20.927464 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-10644fe2-c127-44de-9b10-f47bdf657c73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:20.933406 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-10644fe2-c127-44de-9b10-f47bdf657c73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:20.934504 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-10644fe2-c127-44de-9b10-f47bdf657c73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:20.934720 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-10644fe2-c127-44de-9b10-f47bdf657c73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:20.935123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-10644fe2-c127-44de-9b10-f47bdf657c73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:20.994561 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-10644fe2-c127-44de-9b10-f47bdf657c73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:21.002434 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-10644fe2-c127-44de-9b10-f47bdf657c73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079668 Apr 12 15:03:21.002991 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 513/1001] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:20 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:22.018847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-03d5df50-0e3f-452e-9cfe-6f5dfa4e1536 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:22.019454 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-03d5df50-0e3f-452e-9cfe-6f5dfa4e1536 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:22.025703 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03d5df50-0e3f-452e-9cfe-6f5dfa4e1536 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:22.026154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03d5df50-0e3f-452e-9cfe-6f5dfa4e1536 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:22.026950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03d5df50-0e3f-452e-9cfe-6f5dfa4e1536 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:22.027389 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-03d5df50-0e3f-452e-9cfe-6f5dfa4e1536 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:22.088345 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-03d5df50-0e3f-452e-9cfe-6f5dfa4e1536 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:22.096635 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-03d5df50-0e3f-452e-9cfe-6f5dfa4e1536 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081745 Apr 12 15:03:22.097199 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 489/1002] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:22 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:23.114147 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77fffd1e-4cea-4c74-bae1-23e3e55cc898 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:23.114745 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-77fffd1e-4cea-4c74-bae1-23e3e55cc898 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:23.121009 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77fffd1e-4cea-4c74-bae1-23e3e55cc898 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:23.121455 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77fffd1e-4cea-4c74-bae1-23e3e55cc898 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:23.122245 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77fffd1e-4cea-4c74-bae1-23e3e55cc898 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:23.123307 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77fffd1e-4cea-4c74-bae1-23e3e55cc898 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:23.187062 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-77fffd1e-4cea-4c74-bae1-23e3e55cc898 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:23.194562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-77fffd1e-4cea-4c74-bae1-23e3e55cc898 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084384 Apr 12 15:03:23.195114 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 514/1003] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:23 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:24.211786 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8fe2e163-3b6c-41e3-aa14-27cda6f9b2f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:24.212390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8fe2e163-3b6c-41e3-aa14-27cda6f9b2f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:24.220225 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fe2e163-3b6c-41e3-aa14-27cda6f9b2f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:24.220786 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fe2e163-3b6c-41e3-aa14-27cda6f9b2f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:24.221556 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fe2e163-3b6c-41e3-aa14-27cda6f9b2f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:24.222173 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8fe2e163-3b6c-41e3-aa14-27cda6f9b2f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:24.283356 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8fe2e163-3b6c-41e3-aa14-27cda6f9b2f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:24.290757 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8fe2e163-3b6c-41e3-aa14-27cda6f9b2f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082932 Apr 12 15:03:24.291322 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 490/1004] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:24 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:25.308400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2ac669f6-14e3-43a3-95e5-8119190c7aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:25.308968 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2ac669f6-14e3-43a3-95e5-8119190c7aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:25.315666 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ac669f6-14e3-43a3-95e5-8119190c7aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:25.316115 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ac669f6-14e3-43a3-95e5-8119190c7aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:25.316882 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ac669f6-14e3-43a3-95e5-8119190c7aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:25.317319 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ac669f6-14e3-43a3-95e5-8119190c7aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:25.377947 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2ac669f6-14e3-43a3-95e5-8119190c7aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:25.385322 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2ac669f6-14e3-43a3-95e5-8119190c7aa6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080839 Apr 12 15:03:25.385920 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 515/1005] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:25 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:26.402835 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-082217af-6b02-4b24-8938-69ab81fed97b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:26.403445 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-082217af-6b02-4b24-8938-69ab81fed97b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:26.409943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-082217af-6b02-4b24-8938-69ab81fed97b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:26.410392 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-082217af-6b02-4b24-8938-69ab81fed97b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:26.411161 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-082217af-6b02-4b24-8938-69ab81fed97b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:26.411589 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-082217af-6b02-4b24-8938-69ab81fed97b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:26.484581 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-082217af-6b02-4b24-8938-69ab81fed97b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:26.491753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-082217af-6b02-4b24-8938-69ab81fed97b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.092803 Apr 12 15:03:26.492312 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 491/1006] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:26 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:03:27.509351 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4edfef6a-3397-4d36-92b9-41193a37f724 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:27.510019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4edfef6a-3397-4d36-92b9-41193a37f724 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:27.516886 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4edfef6a-3397-4d36-92b9-41193a37f724 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:27.517329 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4edfef6a-3397-4d36-92b9-41193a37f724 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:27.518113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4edfef6a-3397-4d36-92b9-41193a37f724 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:27.518536 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4edfef6a-3397-4d36-92b9-41193a37f724 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:27.582908 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4edfef6a-3397-4d36-92b9-41193a37f724 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:27.590559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4edfef6a-3397-4d36-92b9-41193a37f724 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085058 Apr 12 15:03:27.591346 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 516/1007] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:27 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:28.609351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2d088199-7f12-4926-adda-0abc4d9f657a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:28.609970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2d088199-7f12-4926-adda-0abc4d9f657a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:28.616307 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2d088199-7f12-4926-adda-0abc4d9f657a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:28.616751 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2d088199-7f12-4926-adda-0abc4d9f657a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:28.617515 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2d088199-7f12-4926-adda-0abc4d9f657a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:28.617971 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2d088199-7f12-4926-adda-0abc4d9f657a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:28.678124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2d088199-7f12-4926-adda-0abc4d9f657a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:28.685995 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2d088199-7f12-4926-adda-0abc4d9f657a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080881 Apr 12 15:03:28.686563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 492/1008] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:28 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:29.703972 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b792eaac-30f3-4b7b-b9d7-7b76a949ca3d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:29.704727 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b792eaac-30f3-4b7b-b9d7-7b76a949ca3d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:29.711517 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b792eaac-30f3-4b7b-b9d7-7b76a949ca3d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:29.711959 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b792eaac-30f3-4b7b-b9d7-7b76a949ca3d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:29.712718 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b792eaac-30f3-4b7b-b9d7-7b76a949ca3d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:29.713146 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b792eaac-30f3-4b7b-b9d7-7b76a949ca3d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:29.773058 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b792eaac-30f3-4b7b-b9d7-7b76a949ca3d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:29.780433 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b792eaac-30f3-4b7b-b9d7-7b76a949ca3d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080781 Apr 12 15:03:29.780993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 517/1009] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:29 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:30.797607 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-cbeb20f2-f883-436f-911b-a1ca2ce59b76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:30.798249 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cbeb20f2-f883-436f-911b-a1ca2ce59b76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:30.804635 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cbeb20f2-f883-436f-911b-a1ca2ce59b76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:30.805081 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cbeb20f2-f883-436f-911b-a1ca2ce59b76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:30.805879 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cbeb20f2-f883-436f-911b-a1ca2ce59b76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:30.806312 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cbeb20f2-f883-436f-911b-a1ca2ce59b76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:30.866329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-cbeb20f2-f883-436f-911b-a1ca2ce59b76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:30.873700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-cbeb20f2-f883-436f-911b-a1ca2ce59b76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079918 Apr 12 15:03:30.874270 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 493/1010] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:30 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:31.891438 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a898588a-a0d0-4164-9a4f-0ae226c3b9fe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:31.892047 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a898588a-a0d0-4164-9a4f-0ae226c3b9fe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:31.899067 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a898588a-a0d0-4164-9a4f-0ae226c3b9fe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:31.899513 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a898588a-a0d0-4164-9a4f-0ae226c3b9fe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:31.900271 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a898588a-a0d0-4164-9a4f-0ae226c3b9fe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:31.900699 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a898588a-a0d0-4164-9a4f-0ae226c3b9fe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:31.962813 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a898588a-a0d0-4164-9a4f-0ae226c3b9fe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:31.970139 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a898588a-a0d0-4164-9a4f-0ae226c3b9fe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082562 Apr 12 15:03:31.970701 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 518/1011] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:31 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:32.987563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-43496313-c2ae-441b-a9df-c5df72385275 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:32.988185 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-43496313-c2ae-441b-a9df-c5df72385275 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:32.995227 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43496313-c2ae-441b-a9df-c5df72385275 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:32.995676 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43496313-c2ae-441b-a9df-c5df72385275 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:32.996498 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43496313-c2ae-441b-a9df-c5df72385275 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:32.996929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43496313-c2ae-441b-a9df-c5df72385275 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:33.058370 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-43496313-c2ae-441b-a9df-c5df72385275 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:33.066205 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-43496313-c2ae-441b-a9df-c5df72385275 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082901 Apr 12 15:03:33.066775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 494/1012] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:32 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:34.082943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-82a83ea2-92de-42de-a315-65cd8d762388 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:34.083544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-82a83ea2-92de-42de-a315-65cd8d762388 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:34.089899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82a83ea2-92de-42de-a315-65cd8d762388 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:34.090395 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82a83ea2-92de-42de-a315-65cd8d762388 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:34.091151 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82a83ea2-92de-42de-a315-65cd8d762388 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:34.091576 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-82a83ea2-92de-42de-a315-65cd8d762388 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:34.152861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-82a83ea2-92de-42de-a315-65cd8d762388 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:34.161295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-82a83ea2-92de-42de-a315-65cd8d762388 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082975 Apr 12 15:03:34.161886 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 519/1013] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:34 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:35.178855 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1696de25-f5fd-4021-af6e-63af9bc001bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:35.179492 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1696de25-f5fd-4021-af6e-63af9bc001bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:35.185751 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1696de25-f5fd-4021-af6e-63af9bc001bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:35.186201 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1696de25-f5fd-4021-af6e-63af9bc001bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:35.186963 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1696de25-f5fd-4021-af6e-63af9bc001bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:35.187392 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1696de25-f5fd-4021-af6e-63af9bc001bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:35.246928 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1696de25-f5fd-4021-af6e-63af9bc001bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:35.255132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1696de25-f5fd-4021-af6e-63af9bc001bc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080882 Apr 12 15:03:35.255693 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 495/1014] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:35 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:36.272291 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8cebc3be-590c-4d08-8cb0-7075a33a883a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:36.272874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8cebc3be-590c-4d08-8cb0-7075a33a883a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:36.279465 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8cebc3be-590c-4d08-8cb0-7075a33a883a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:36.279909 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8cebc3be-590c-4d08-8cb0-7075a33a883a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:36.280669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8cebc3be-590c-4d08-8cb0-7075a33a883a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:36.281160 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8cebc3be-590c-4d08-8cb0-7075a33a883a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:36.344634 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8cebc3be-590c-4d08-8cb0-7075a33a883a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:36.352196 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8cebc3be-590c-4d08-8cb0-7075a33a883a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084980 Apr 12 15:03:36.352760 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 520/1015] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:36 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:37.369115 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4ab95c4b-1803-4eab-b3fb-3b1c24135b78 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:37.369693 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4ab95c4b-1803-4eab-b3fb-3b1c24135b78 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:37.375484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ab95c4b-1803-4eab-b3fb-3b1c24135b78 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:37.375925 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ab95c4b-1803-4eab-b3fb-3b1c24135b78 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:37.376682 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ab95c4b-1803-4eab-b3fb-3b1c24135b78 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:37.377105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ab95c4b-1803-4eab-b3fb-3b1c24135b78 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:37.435643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4ab95c4b-1803-4eab-b3fb-3b1c24135b78 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:37.443481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4ab95c4b-1803-4eab-b3fb-3b1c24135b78 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078442 Apr 12 15:03:37.444034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 496/1016] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:37 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:38.460833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1d8d8778-1980-4de1-9253-fdf57c606739 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:38.461494 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1d8d8778-1980-4de1-9253-fdf57c606739 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:38.467963 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d8d8778-1980-4de1-9253-fdf57c606739 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:38.468416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d8d8778-1980-4de1-9253-fdf57c606739 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:38.469223 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d8d8778-1980-4de1-9253-fdf57c606739 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:38.469684 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d8d8778-1980-4de1-9253-fdf57c606739 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:38.542828 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1d8d8778-1980-4de1-9253-fdf57c606739 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:38.550996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1d8d8778-1980-4de1-9253-fdf57c606739 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.094150 Apr 12 15:03:38.551573 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 521/1017] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:38 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:39.568637 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a716feda-9c25-4b55-9187-bf7fdc9a0376 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:39.569275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a716feda-9c25-4b55-9187-bf7fdc9a0376 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:39.575721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a716feda-9c25-4b55-9187-bf7fdc9a0376 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:39.576171 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a716feda-9c25-4b55-9187-bf7fdc9a0376 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:39.576943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a716feda-9c25-4b55-9187-bf7fdc9a0376 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:39.577380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a716feda-9c25-4b55-9187-bf7fdc9a0376 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:39.638115 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a716feda-9c25-4b55-9187-bf7fdc9a0376 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:39.644124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a716feda-9c25-4b55-9187-bf7fdc9a0376 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080229 Apr 12 15:03:39.644807 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 497/1018] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:39 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:40.661660 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a3551243-6797-4e8f-9f26-2a58a8d70f62 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:40.662431 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a3551243-6797-4e8f-9f26-2a58a8d70f62 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:40.668747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3551243-6797-4e8f-9f26-2a58a8d70f62 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:40.669196 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3551243-6797-4e8f-9f26-2a58a8d70f62 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:40.669995 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3551243-6797-4e8f-9f26-2a58a8d70f62 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:40.670430 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a3551243-6797-4e8f-9f26-2a58a8d70f62 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:40.735407 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a3551243-6797-4e8f-9f26-2a58a8d70f62 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:40.743660 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a3551243-6797-4e8f-9f26-2a58a8d70f62 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086438 Apr 12 15:03:40.744313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 522/1019] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:40 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:41.760327 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-62768d4e-73ca-4683-86a7-9275d45e65fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:41.760867 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-62768d4e-73ca-4683-86a7-9275d45e65fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:41.767160 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62768d4e-73ca-4683-86a7-9275d45e65fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:41.767606 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62768d4e-73ca-4683-86a7-9275d45e65fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:41.768366 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62768d4e-73ca-4683-86a7-9275d45e65fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:41.769306 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62768d4e-73ca-4683-86a7-9275d45e65fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:41.827242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-62768d4e-73ca-4683-86a7-9275d45e65fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:41.835096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-62768d4e-73ca-4683-86a7-9275d45e65fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078706 Apr 12 15:03:41.835790 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 498/1020] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:41 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:42.851827 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d9bbbb24-9f7c-434f-a074-ee8cc84d6357 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:42.852338 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d9bbbb24-9f7c-434f-a074-ee8cc84d6357 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:42.858693 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d9bbbb24-9f7c-434f-a074-ee8cc84d6357 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:42.859137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d9bbbb24-9f7c-434f-a074-ee8cc84d6357 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:42.859900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d9bbbb24-9f7c-434f-a074-ee8cc84d6357 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:42.860329 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d9bbbb24-9f7c-434f-a074-ee8cc84d6357 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:42.923998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d9bbbb24-9f7c-434f-a074-ee8cc84d6357 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:42.932948 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d9bbbb24-9f7c-434f-a074-ee8cc84d6357 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085013 Apr 12 15:03:42.933651 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 523/1021] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:42 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:43.950676 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7ba3898c-8002-4f4b-9855-9bf00295e0a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:43.956424 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7ba3898c-8002-4f4b-9855-9bf00295e0a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:43.958536 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ba3898c-8002-4f4b-9855-9bf00295e0a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:43.958984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ba3898c-8002-4f4b-9855-9bf00295e0a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:43.959766 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ba3898c-8002-4f4b-9855-9bf00295e0a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:43.960231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7ba3898c-8002-4f4b-9855-9bf00295e0a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:44.023858 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7ba3898c-8002-4f4b-9855-9bf00295e0a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:44.031474 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7ba3898c-8002-4f4b-9855-9bf00295e0a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085074 Apr 12 15:03:44.032041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 499/1022] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:43 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:03:45.048046 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e5e8b245-3734-4a8f-bc4a-b5248912659c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:45.048566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e5e8b245-3734-4a8f-bc4a-b5248912659c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:45.055735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5e8b245-3734-4a8f-bc4a-b5248912659c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:45.056179 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5e8b245-3734-4a8f-bc4a-b5248912659c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:45.056942 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5e8b245-3734-4a8f-bc4a-b5248912659c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:45.057375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5e8b245-3734-4a8f-bc4a-b5248912659c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:45.125206 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e5e8b245-3734-4a8f-bc4a-b5248912659c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:45.133172 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e5e8b245-3734-4a8f-bc4a-b5248912659c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.088937 Apr 12 15:03:45.133767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 524/1023] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:45 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:46.150575 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d84691c9-6aee-4b85-a893-ff6bc399231f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:46.151170 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d84691c9-6aee-4b85-a893-ff6bc399231f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:46.157364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d84691c9-6aee-4b85-a893-ff6bc399231f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:46.157839 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d84691c9-6aee-4b85-a893-ff6bc399231f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:46.158595 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d84691c9-6aee-4b85-a893-ff6bc399231f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:46.159051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d84691c9-6aee-4b85-a893-ff6bc399231f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:46.217791 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d84691c9-6aee-4b85-a893-ff6bc399231f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:46.225945 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d84691c9-6aee-4b85-a893-ff6bc399231f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079158 Apr 12 15:03:46.226516 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 500/1024] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:46 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:47.242655 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a818eec7-a161-4c73-b94d-d473dcc8fa91 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:47.243262 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a818eec7-a161-4c73-b94d-d473dcc8fa91 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:47.249600 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a818eec7-a161-4c73-b94d-d473dcc8fa91 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:47.250079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a818eec7-a161-4c73-b94d-d473dcc8fa91 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:47.250845 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a818eec7-a161-4c73-b94d-d473dcc8fa91 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:47.251277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a818eec7-a161-4c73-b94d-d473dcc8fa91 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:47.312841 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a818eec7-a161-4c73-b94d-d473dcc8fa91 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:47.321444 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a818eec7-a161-4c73-b94d-d473dcc8fa91 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082773 Apr 12 15:03:47.322019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 525/1025] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:47 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:48.338567 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dd62bc9b-2d19-410d-bda8-adb792d4a283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:48.339167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dd62bc9b-2d19-410d-bda8-adb792d4a283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:48.345872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd62bc9b-2d19-410d-bda8-adb792d4a283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:48.346365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd62bc9b-2d19-410d-bda8-adb792d4a283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:48.347256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd62bc9b-2d19-410d-bda8-adb792d4a283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:48.347682 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd62bc9b-2d19-410d-bda8-adb792d4a283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:48.409399 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd62bc9b-2d19-410d-bda8-adb792d4a283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:48.417848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dd62bc9b-2d19-410d-bda8-adb792d4a283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083101 Apr 12 15:03:48.418406 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 501/1026] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:48 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:49.434060 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0711de65-4bd8-4c30-9c62-42e6bf7e2920 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:49.434600 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0711de65-4bd8-4c30-9c62-42e6bf7e2920 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:49.440744 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0711de65-4bd8-4c30-9c62-42e6bf7e2920 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:49.441193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0711de65-4bd8-4c30-9c62-42e6bf7e2920 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:49.442155 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0711de65-4bd8-4c30-9c62-42e6bf7e2920 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:49.442705 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0711de65-4bd8-4c30-9c62-42e6bf7e2920 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:49.503997 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0711de65-4bd8-4c30-9c62-42e6bf7e2920 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:49.511466 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0711de65-4bd8-4c30-9c62-42e6bf7e2920 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081593 Apr 12 15:03:49.512024 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 526/1027] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:49 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:50.528753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9826a9bd-6c78-4cf0-9a1f-f1a77c63f8c6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:50.529376 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9826a9bd-6c78-4cf0-9a1f-f1a77c63f8c6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:50.536426 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9826a9bd-6c78-4cf0-9a1f-f1a77c63f8c6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:50.536870 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9826a9bd-6c78-4cf0-9a1f-f1a77c63f8c6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:50.537669 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9826a9bd-6c78-4cf0-9a1f-f1a77c63f8c6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:50.538104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9826a9bd-6c78-4cf0-9a1f-f1a77c63f8c6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:50.850797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9826a9bd-6c78-4cf0-9a1f-f1a77c63f8c6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:50.858200 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9826a9bd-6c78-4cf0-9a1f-f1a77c63f8c6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.333427 Apr 12 15:03:50.858760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 502/1028] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:50 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:51.876053 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e94819d9-e104-4783-b007-d1714a00797c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:51.876598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e94819d9-e104-4783-b007-d1714a00797c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:51.883498 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e94819d9-e104-4783-b007-d1714a00797c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:51.883948 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e94819d9-e104-4783-b007-d1714a00797c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:51.884706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e94819d9-e104-4783-b007-d1714a00797c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:51.885132 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e94819d9-e104-4783-b007-d1714a00797c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:51.946290 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e94819d9-e104-4783-b007-d1714a00797c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:51.953874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e94819d9-e104-4783-b007-d1714a00797c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081836 Apr 12 15:03:51.954496 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 527/1029] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:51 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:03:52.975658 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3715be01-6ce2-4c22-8228-a998f50e2c09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:52.976401 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3715be01-6ce2-4c22-8228-a998f50e2c09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:52.982635 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3715be01-6ce2-4c22-8228-a998f50e2c09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:52.983084 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3715be01-6ce2-4c22-8228-a998f50e2c09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:52.983849 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3715be01-6ce2-4c22-8228-a998f50e2c09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:52.984280 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3715be01-6ce2-4c22-8228-a998f50e2c09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:53.043341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3715be01-6ce2-4c22-8228-a998f50e2c09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:53.051011 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3715be01-6ce2-4c22-8228-a998f50e2c09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079768 Apr 12 15:03:53.052320 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 503/1030] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:52 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:54.071269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f2c940af-117a-44d6-9846-769a4ec0bea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:54.072262 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f2c940af-117a-44d6-9846-769a4ec0bea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:54.078599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2c940af-117a-44d6-9846-769a4ec0bea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:54.079041 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2c940af-117a-44d6-9846-769a4ec0bea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:54.079804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2c940af-117a-44d6-9846-769a4ec0bea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:54.080231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f2c940af-117a-44d6-9846-769a4ec0bea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:54.141281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f2c940af-117a-44d6-9846-769a4ec0bea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:54.148886 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f2c940af-117a-44d6-9846-769a4ec0bea7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083857 Apr 12 15:03:54.149450 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 528/1031] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:54 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:55.166960 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8e62dfb2-cc95-4900-91d5-8f65a699dfba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:55.167678 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8e62dfb2-cc95-4900-91d5-8f65a699dfba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:55.174508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8e62dfb2-cc95-4900-91d5-8f65a699dfba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:55.174956 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8e62dfb2-cc95-4900-91d5-8f65a699dfba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:55.175734 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8e62dfb2-cc95-4900-91d5-8f65a699dfba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:55.176163 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8e62dfb2-cc95-4900-91d5-8f65a699dfba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:55.238660 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8e62dfb2-cc95-4900-91d5-8f65a699dfba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:55.247025 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8e62dfb2-cc95-4900-91d5-8f65a699dfba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084752 Apr 12 15:03:55.247653 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 504/1032] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:55 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:56.265515 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0caec50b-9090-43ae-8681-06ef10f8152e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:56.266563 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0caec50b-9090-43ae-8681-06ef10f8152e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:56.273933 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0caec50b-9090-43ae-8681-06ef10f8152e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:56.274316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0caec50b-9090-43ae-8681-06ef10f8152e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:56.275082 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0caec50b-9090-43ae-8681-06ef10f8152e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:56.275506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0caec50b-9090-43ae-8681-06ef10f8152e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:56.337856 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0caec50b-9090-43ae-8681-06ef10f8152e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:56.345229 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0caec50b-9090-43ae-8681-06ef10f8152e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083628 Apr 12 15:03:56.345843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 529/1033] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:56 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:03:57.361311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-37a6a7a1-84b6-4537-999d-bf9fdc11920e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:57.362158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-37a6a7a1-84b6-4537-999d-bf9fdc11920e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:57.370165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37a6a7a1-84b6-4537-999d-bf9fdc11920e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:57.370603 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37a6a7a1-84b6-4537-999d-bf9fdc11920e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:57.371382 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37a6a7a1-84b6-4537-999d-bf9fdc11920e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:57.371817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37a6a7a1-84b6-4537-999d-bf9fdc11920e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:57.446922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-37a6a7a1-84b6-4537-999d-bf9fdc11920e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:57.455355 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-37a6a7a1-84b6-4537-999d-bf9fdc11920e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.097775 Apr 12 15:03:57.455949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 505/1034] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:57 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:58.474122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-910aefd1-8826-4913-818c-dcce35309522 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:58.474686 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-910aefd1-8826-4913-818c-dcce35309522 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:58.481520 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-910aefd1-8826-4913-818c-dcce35309522 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:58.482001 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-910aefd1-8826-4913-818c-dcce35309522 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:58.482773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-910aefd1-8826-4913-818c-dcce35309522 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:58.483210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-910aefd1-8826-4913-818c-dcce35309522 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:58.543693 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-910aefd1-8826-4913-818c-dcce35309522 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:58.551713 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-910aefd1-8826-4913-818c-dcce35309522 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081538 Apr 12 15:03:58.552277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 530/1035] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:58 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:03:59.568735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-507a7073-948e-4482-af71-1503587fef4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:03:59.569342 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-507a7073-948e-4482-af71-1503587fef4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:03:59.576351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-507a7073-948e-4482-af71-1503587fef4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:59.576796 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-507a7073-948e-4482-af71-1503587fef4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:59.577564 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-507a7073-948e-4482-af71-1503587fef4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:03:59.578017 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-507a7073-948e-4482-af71-1503587fef4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:03:59.639554 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-507a7073-948e-4482-af71-1503587fef4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:03:59.644188 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-507a7073-948e-4482-af71-1503587fef4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079302 Apr 12 15:03:59.644753 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 506/1036] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:03:59 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:00.660323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-baa67904-f645-4688-a138-09d4906a7438 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:00.660924 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-baa67904-f645-4688-a138-09d4906a7438 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:00.667549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-baa67904-f645-4688-a138-09d4906a7438 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:00.667996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-baa67904-f645-4688-a138-09d4906a7438 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:00.668760 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-baa67904-f645-4688-a138-09d4906a7438 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:00.669188 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-baa67904-f645-4688-a138-09d4906a7438 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:00.732175 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-baa67904-f645-4688-a138-09d4906a7438 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:00.743336 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-baa67904-f645-4688-a138-09d4906a7438 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086542 Apr 12 15:04:00.744389 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 531/1037] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:00 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:01.762820 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-aac58fc0-aee1-4529-9e90-0322a1575f09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:01.763380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-aac58fc0-aee1-4529-9e90-0322a1575f09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:01.769704 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aac58fc0-aee1-4529-9e90-0322a1575f09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:01.770159 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aac58fc0-aee1-4529-9e90-0322a1575f09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:01.770932 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aac58fc0-aee1-4529-9e90-0322a1575f09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:01.771373 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aac58fc0-aee1-4529-9e90-0322a1575f09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:01.832749 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-aac58fc0-aee1-4529-9e90-0322a1575f09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:01.841535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-aac58fc0-aee1-4529-9e90-0322a1575f09 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082612 Apr 12 15:04:01.842162 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 507/1038] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:01 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:02.858376 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-75060ae7-6560-414c-b582-bd9b8a2de9c9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:02.858979 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-75060ae7-6560-414c-b582-bd9b8a2de9c9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:02.865160 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75060ae7-6560-414c-b582-bd9b8a2de9c9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:02.865603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75060ae7-6560-414c-b582-bd9b8a2de9c9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:02.866390 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75060ae7-6560-414c-b582-bd9b8a2de9c9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:02.866818 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-75060ae7-6560-414c-b582-bd9b8a2de9c9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:02.927889 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-75060ae7-6560-414c-b582-bd9b8a2de9c9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:02.936542 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-75060ae7-6560-414c-b582-bd9b8a2de9c9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081740 Apr 12 15:04:02.937316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 532/1039] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:02 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:03.954444 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e109d5e6-d162-4b8a-8cd3-6533ca709754 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:03.955194 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e109d5e6-d162-4b8a-8cd3-6533ca709754 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:03.962215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e109d5e6-d162-4b8a-8cd3-6533ca709754 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:03.962825 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e109d5e6-d162-4b8a-8cd3-6533ca709754 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:03.963617 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e109d5e6-d162-4b8a-8cd3-6533ca709754 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:03.964056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e109d5e6-d162-4b8a-8cd3-6533ca709754 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:04.029687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e109d5e6-d162-4b8a-8cd3-6533ca709754 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:04.037091 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e109d5e6-d162-4b8a-8cd3-6533ca709754 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086467 Apr 12 15:04:04.037673 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 508/1040] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:03 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:05.054514 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-50baab38-12cd-4aab-85c6-2fd3422feebc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:05.055130 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-50baab38-12cd-4aab-85c6-2fd3422feebc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:05.061917 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50baab38-12cd-4aab-85c6-2fd3422feebc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:05.062378 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50baab38-12cd-4aab-85c6-2fd3422feebc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:05.063151 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50baab38-12cd-4aab-85c6-2fd3422feebc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:05.063890 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50baab38-12cd-4aab-85c6-2fd3422feebc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:05.125850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-50baab38-12cd-4aab-85c6-2fd3422feebc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:05.133169 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-50baab38-12cd-4aab-85c6-2fd3422feebc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082533 Apr 12 15:04:05.134367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 533/1041] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:05 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:06.151385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6c87df73-ce4b-45be-83aa-f32b5e21affb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:06.151990 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6c87df73-ce4b-45be-83aa-f32b5e21affb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:06.158020 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c87df73-ce4b-45be-83aa-f32b5e21affb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:06.158467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c87df73-ce4b-45be-83aa-f32b5e21affb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:06.159261 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c87df73-ce4b-45be-83aa-f32b5e21affb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:06.159693 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c87df73-ce4b-45be-83aa-f32b5e21affb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:06.221882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6c87df73-ce4b-45be-83aa-f32b5e21affb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:06.230089 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6c87df73-ce4b-45be-83aa-f32b5e21affb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083265 Apr 12 15:04:06.230896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 509/1042] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:06 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:07.248049 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f9108ec8-13a3-4fa8-a42e-5e77df24e11f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:07.248654 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f9108ec8-13a3-4fa8-a42e-5e77df24e11f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:07.256159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f9108ec8-13a3-4fa8-a42e-5e77df24e11f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:07.256657 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f9108ec8-13a3-4fa8-a42e-5e77df24e11f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:07.257495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f9108ec8-13a3-4fa8-a42e-5e77df24e11f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:07.257954 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f9108ec8-13a3-4fa8-a42e-5e77df24e11f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:07.318225 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f9108ec8-13a3-4fa8-a42e-5e77df24e11f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:07.325625 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f9108ec8-13a3-4fa8-a42e-5e77df24e11f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081500 Apr 12 15:04:07.326216 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 534/1043] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:07 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:08.342965 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d143ccc6-6945-407b-a075-427b6a68dfbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:08.343494 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d143ccc6-6945-407b-a075-427b6a68dfbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:08.350134 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d143ccc6-6945-407b-a075-427b6a68dfbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:08.350580 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d143ccc6-6945-407b-a075-427b6a68dfbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:08.351348 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d143ccc6-6945-407b-a075-427b6a68dfbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:08.351777 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d143ccc6-6945-407b-a075-427b6a68dfbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:08.411235 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d143ccc6-6945-407b-a075-427b6a68dfbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:08.419423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d143ccc6-6945-407b-a075-427b6a68dfbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080481 Apr 12 15:04:08.419995 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 510/1044] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:08 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:09.437313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cfc8821a-9061-43c5-93ec-81a251f6f199 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:09.437872 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cfc8821a-9061-43c5-93ec-81a251f6f199 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:09.444406 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfc8821a-9061-43c5-93ec-81a251f6f199 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:09.444845 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfc8821a-9061-43c5-93ec-81a251f6f199 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:09.445606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfc8821a-9061-43c5-93ec-81a251f6f199 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:09.446061 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfc8821a-9061-43c5-93ec-81a251f6f199 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:09.506508 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cfc8821a-9061-43c5-93ec-81a251f6f199 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:09.514064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cfc8821a-9061-43c5-93ec-81a251f6f199 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081716 Apr 12 15:04:09.514644 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 535/1045] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:09 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:10.530600 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b660b3cb-ed46-438c-ba0b-adf0c16f3d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:10.531342 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b660b3cb-ed46-438c-ba0b-adf0c16f3d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:10.537950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b660b3cb-ed46-438c-ba0b-adf0c16f3d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:10.538459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b660b3cb-ed46-438c-ba0b-adf0c16f3d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:10.539266 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b660b3cb-ed46-438c-ba0b-adf0c16f3d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:10.539699 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b660b3cb-ed46-438c-ba0b-adf0c16f3d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:10.602481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b660b3cb-ed46-438c-ba0b-adf0c16f3d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:10.610124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b660b3cb-ed46-438c-ba0b-adf0c16f3d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083413 Apr 12 15:04:10.610691 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 511/1046] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:10 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:11.627827 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3ea5e48b-d521-4cf2-bf2b-5e9f4211bbe5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:11.628425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3ea5e48b-d521-4cf2-bf2b-5e9f4211bbe5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:11.634861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ea5e48b-d521-4cf2-bf2b-5e9f4211bbe5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:11.641884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ea5e48b-d521-4cf2-bf2b-5e9f4211bbe5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:11.641884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ea5e48b-d521-4cf2-bf2b-5e9f4211bbe5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:11.641884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3ea5e48b-d521-4cf2-bf2b-5e9f4211bbe5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:11.701718 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3ea5e48b-d521-4cf2-bf2b-5e9f4211bbe5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:11.709139 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3ea5e48b-d521-4cf2-bf2b-5e9f4211bbe5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085269 Apr 12 15:04:11.709724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 536/1047] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:11 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:12.724952 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-aebe8ffc-d8aa-49ba-a85a-f7a5c851b097 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:12.725548 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-aebe8ffc-d8aa-49ba-a85a-f7a5c851b097 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:12.732683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aebe8ffc-d8aa-49ba-a85a-f7a5c851b097 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:12.733229 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aebe8ffc-d8aa-49ba-a85a-f7a5c851b097 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:12.734030 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aebe8ffc-d8aa-49ba-a85a-f7a5c851b097 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:12.734463 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aebe8ffc-d8aa-49ba-a85a-f7a5c851b097 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:12.795371 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-aebe8ffc-d8aa-49ba-a85a-f7a5c851b097 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:12.802915 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-aebe8ffc-d8aa-49ba-a85a-f7a5c851b097 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081871 Apr 12 15:04:12.803393 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 512/1048] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:12 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:13.819618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7ce95a06-24b9-4129-b3d7-aa26bb85da9f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:13.820313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7ce95a06-24b9-4129-b3d7-aa26bb85da9f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:13.827477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ce95a06-24b9-4129-b3d7-aa26bb85da9f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:13.827928 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ce95a06-24b9-4129-b3d7-aa26bb85da9f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:13.828695 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ce95a06-24b9-4129-b3d7-aa26bb85da9f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:13.829126 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7ce95a06-24b9-4129-b3d7-aa26bb85da9f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:13.889207 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7ce95a06-24b9-4129-b3d7-aa26bb85da9f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:13.896793 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7ce95a06-24b9-4129-b3d7-aa26bb85da9f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081060 Apr 12 15:04:13.897363 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 537/1049] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:13 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:14.914281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d85d22ac-5cf7-430d-aee3-d3068e7f914b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:14.914872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d85d22ac-5cf7-430d-aee3-d3068e7f914b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:14.921096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85d22ac-5cf7-430d-aee3-d3068e7f914b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:14.921545 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85d22ac-5cf7-430d-aee3-d3068e7f914b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:14.922520 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85d22ac-5cf7-430d-aee3-d3068e7f914b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:14.922954 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85d22ac-5cf7-430d-aee3-d3068e7f914b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:14.985135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d85d22ac-5cf7-430d-aee3-d3068e7f914b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:14.992649 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d85d22ac-5cf7-430d-aee3-d3068e7f914b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082261 Apr 12 15:04:14.993211 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 513/1050] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:14 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:16.010393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-60c00d35-d5c2-4276-aef2-ab796cf49a79 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:16.011008 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-60c00d35-d5c2-4276-aef2-ab796cf49a79 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:16.018075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60c00d35-d5c2-4276-aef2-ab796cf49a79 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:16.018519 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60c00d35-d5c2-4276-aef2-ab796cf49a79 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:16.019285 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60c00d35-d5c2-4276-aef2-ab796cf49a79 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:16.019717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60c00d35-d5c2-4276-aef2-ab796cf49a79 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:16.183400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-60c00d35-d5c2-4276-aef2-ab796cf49a79 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:16.192308 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-60c00d35-d5c2-4276-aef2-ab796cf49a79 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.185962 Apr 12 15:04:16.192873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 538/1051] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:16 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:17.210118 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2f81ef29-60a8-479f-9d2e-dfa86c4bd7cd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:17.210781 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2f81ef29-60a8-479f-9d2e-dfa86c4bd7cd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:17.217124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f81ef29-60a8-479f-9d2e-dfa86c4bd7cd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:17.217575 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f81ef29-60a8-479f-9d2e-dfa86c4bd7cd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:17.218446 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f81ef29-60a8-479f-9d2e-dfa86c4bd7cd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:17.218885 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f81ef29-60a8-479f-9d2e-dfa86c4bd7cd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:17.328709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2f81ef29-60a8-479f-9d2e-dfa86c4bd7cd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:17.336694 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2f81ef29-60a8-479f-9d2e-dfa86c4bd7cd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.130494 Apr 12 15:04:17.337256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 514/1052] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:17 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:04:18.353229 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-eed2875c-3bd8-4b9f-9762-c3038ef3e16c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:18.353870 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-eed2875c-3bd8-4b9f-9762-c3038ef3e16c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:18.360214 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eed2875c-3bd8-4b9f-9762-c3038ef3e16c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:18.360664 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eed2875c-3bd8-4b9f-9762-c3038ef3e16c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:18.361500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eed2875c-3bd8-4b9f-9762-c3038ef3e16c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:18.361956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eed2875c-3bd8-4b9f-9762-c3038ef3e16c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:18.421175 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-eed2875c-3bd8-4b9f-9762-c3038ef3e16c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:18.428990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-eed2875c-3bd8-4b9f-9762-c3038ef3e16c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079624 Apr 12 15:04:18.429551 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 539/1053] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:18 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:19.446134 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-91a10d92-d4b2-40a2-8620-fb2fd5c8dd1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:19.446762 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-91a10d92-d4b2-40a2-8620-fb2fd5c8dd1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:19.453074 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91a10d92-d4b2-40a2-8620-fb2fd5c8dd1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:19.453526 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91a10d92-d4b2-40a2-8620-fb2fd5c8dd1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:19.454326 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91a10d92-d4b2-40a2-8620-fb2fd5c8dd1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:19.454825 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91a10d92-d4b2-40a2-8620-fb2fd5c8dd1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:19.522388 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-91a10d92-d4b2-40a2-8620-fb2fd5c8dd1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:19.532128 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-91a10d92-d4b2-40a2-8620-fb2fd5c8dd1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.089755 Apr 12 15:04:19.533227 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 515/1054] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:19 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:20.551193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-273ecb39-d4a7-4cb0-b3d9-8eb36b9f2729 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:20.551800 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-273ecb39-d4a7-4cb0-b3d9-8eb36b9f2729 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:20.557613 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-273ecb39-d4a7-4cb0-b3d9-8eb36b9f2729 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:20.558164 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-273ecb39-d4a7-4cb0-b3d9-8eb36b9f2729 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:20.558929 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-273ecb39-d4a7-4cb0-b3d9-8eb36b9f2729 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:20.559357 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-273ecb39-d4a7-4cb0-b3d9-8eb36b9f2729 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:20.619657 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-273ecb39-d4a7-4cb0-b3d9-8eb36b9f2729 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:20.627698 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-273ecb39-d4a7-4cb0-b3d9-8eb36b9f2729 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081898 Apr 12 15:04:20.628254 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 540/1055] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:20 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:21.645345 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-118c34d1-c09d-4fdf-add4-3a7ed4b93c28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:21.645984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-118c34d1-c09d-4fdf-add4-3a7ed4b93c28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:21.652282 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-118c34d1-c09d-4fdf-add4-3a7ed4b93c28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:21.652724 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-118c34d1-c09d-4fdf-add4-3a7ed4b93c28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:21.653491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-118c34d1-c09d-4fdf-add4-3a7ed4b93c28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:21.653953 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-118c34d1-c09d-4fdf-add4-3a7ed4b93c28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:21.713814 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-118c34d1-c09d-4fdf-add4-3a7ed4b93c28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:21.721614 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-118c34d1-c09d-4fdf-add4-3a7ed4b93c28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080910 Apr 12 15:04:21.722751 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 516/1056] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:21 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:22.739893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-28941674-3502-46d2-941c-b4618b263c1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:22.740521 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-28941674-3502-46d2-941c-b4618b263c1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:22.747113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28941674-3502-46d2-941c-b4618b263c1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:22.747552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28941674-3502-46d2-941c-b4618b263c1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:22.748306 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28941674-3502-46d2-941c-b4618b263c1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:22.748761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28941674-3502-46d2-941c-b4618b263c1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:22.811369 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-28941674-3502-46d2-941c-b4618b263c1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:22.820412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-28941674-3502-46d2-941c-b4618b263c1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085005 Apr 12 15:04:22.821012 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 541/1057] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:22 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:23.837757 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-65cc4e3f-9698-4064-be78-3d13c61ace65 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:23.838400 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-65cc4e3f-9698-4064-be78-3d13c61ace65 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:23.845025 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-65cc4e3f-9698-4064-be78-3d13c61ace65 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:23.845470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-65cc4e3f-9698-4064-be78-3d13c61ace65 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:23.846263 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-65cc4e3f-9698-4064-be78-3d13c61ace65 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:23.846732 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-65cc4e3f-9698-4064-be78-3d13c61ace65 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:23.912981 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-65cc4e3f-9698-4064-be78-3d13c61ace65 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:23.920804 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-65cc4e3f-9698-4064-be78-3d13c61ace65 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.087664 Apr 12 15:04:23.921367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 517/1058] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:23 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:24.937085 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ca38a2ea-0c44-4114-a0d7-155a5346ff54 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:24.938123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ca38a2ea-0c44-4114-a0d7-155a5346ff54 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:24.944915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca38a2ea-0c44-4114-a0d7-155a5346ff54 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:24.945375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca38a2ea-0c44-4114-a0d7-155a5346ff54 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:24.946401 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca38a2ea-0c44-4114-a0d7-155a5346ff54 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:24.946624 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ca38a2ea-0c44-4114-a0d7-155a5346ff54 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:25.009935 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ca38a2ea-0c44-4114-a0d7-155a5346ff54 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:25.017358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ca38a2ea-0c44-4114-a0d7-155a5346ff54 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084168 Apr 12 15:04:25.017967 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 542/1059] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:24 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:25.588308 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:04:25.588517 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:04:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:04:26.035843 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c7f2d1e4-5474-43c0-b48d-76b6102e84a8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:26.036503 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c7f2d1e4-5474-43c0-b48d-76b6102e84a8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:26.043366 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c7f2d1e4-5474-43c0-b48d-76b6102e84a8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:26.043809 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c7f2d1e4-5474-43c0-b48d-76b6102e84a8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:26.044568 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c7f2d1e4-5474-43c0-b48d-76b6102e84a8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:26.044991 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c7f2d1e4-5474-43c0-b48d-76b6102e84a8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:26.104716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c7f2d1e4-5474-43c0-b48d-76b6102e84a8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:26.111993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c7f2d1e4-5474-43c0-b48d-76b6102e84a8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080353 Apr 12 15:04:26.112553 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 518/1060] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:26 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:27.012778 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:04:27.012778 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:04:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:04:27.128227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-24b2b7bf-1759-4a10-a943-9dbf76487fc6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:27.128981 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-24b2b7bf-1759-4a10-a943-9dbf76487fc6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:27.136539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-24b2b7bf-1759-4a10-a943-9dbf76487fc6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:27.137055 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-24b2b7bf-1759-4a10-a943-9dbf76487fc6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:27.137847 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-24b2b7bf-1759-4a10-a943-9dbf76487fc6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:27.138275 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-24b2b7bf-1759-4a10-a943-9dbf76487fc6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:27.206883 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-24b2b7bf-1759-4a10-a943-9dbf76487fc6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:27.215131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-24b2b7bf-1759-4a10-a943-9dbf76487fc6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.090736 Apr 12 15:04:27.215617 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 543/1061] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:27 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:28.231987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-53da21cd-596d-41b4-b818-31b26eee4e92 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:28.232578 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-53da21cd-596d-41b4-b818-31b26eee4e92 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:28.239384 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53da21cd-596d-41b4-b818-31b26eee4e92 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:28.239830 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53da21cd-596d-41b4-b818-31b26eee4e92 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:28.240597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53da21cd-596d-41b4-b818-31b26eee4e92 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:28.241028 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-53da21cd-596d-41b4-b818-31b26eee4e92 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:28.303063 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-53da21cd-596d-41b4-b818-31b26eee4e92 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:28.311292 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-53da21cd-596d-41b4-b818-31b26eee4e92 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083149 Apr 12 15:04:28.311860 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 519/1062] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:28 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:29.329005 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8037d37e-1d6d-4167-b7dd-5d172f2e467a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:29.329551 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8037d37e-1d6d-4167-b7dd-5d172f2e467a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:29.336557 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8037d37e-1d6d-4167-b7dd-5d172f2e467a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:29.337002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8037d37e-1d6d-4167-b7dd-5d172f2e467a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:29.337793 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8037d37e-1d6d-4167-b7dd-5d172f2e467a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:29.338224 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8037d37e-1d6d-4167-b7dd-5d172f2e467a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:29.398492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8037d37e-1d6d-4167-b7dd-5d172f2e467a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:29.405751 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8037d37e-1d6d-4167-b7dd-5d172f2e467a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080809 Apr 12 15:04:29.406304 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 544/1063] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:29 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:30.422442 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e85d0b00-87ca-4716-8c55-de7f77e866dd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:30.422985 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e85d0b00-87ca-4716-8c55-de7f77e866dd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:30.429347 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e85d0b00-87ca-4716-8c55-de7f77e866dd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:30.430441 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e85d0b00-87ca-4716-8c55-de7f77e866dd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:30.431218 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e85d0b00-87ca-4716-8c55-de7f77e866dd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:30.431651 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e85d0b00-87ca-4716-8c55-de7f77e866dd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:30.490130 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e85d0b00-87ca-4716-8c55-de7f77e866dd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:30.498034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e85d0b00-87ca-4716-8c55-de7f77e866dd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079647 Apr 12 15:04:30.498596 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 520/1064] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:30 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:31.515133 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4ed140d0-f734-46be-babc-984a3a4e943a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:31.515684 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4ed140d0-f734-46be-babc-984a3a4e943a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:31.522066 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ed140d0-f734-46be-babc-984a3a4e943a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:31.522522 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ed140d0-f734-46be-babc-984a3a4e943a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:31.523307 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ed140d0-f734-46be-babc-984a3a4e943a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:31.524065 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ed140d0-f734-46be-babc-984a3a4e943a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:31.584335 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4ed140d0-f734-46be-babc-984a3a4e943a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:31.592167 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4ed140d0-f734-46be-babc-984a3a4e943a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081065 Apr 12 15:04:31.592733 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 545/1065] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:31 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:32.608790 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-88d1d53f-8ccc-4579-823e-ee6d298883d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:32.609397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-88d1d53f-8ccc-4579-823e-ee6d298883d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:32.615688 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88d1d53f-8ccc-4579-823e-ee6d298883d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:32.616136 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88d1d53f-8ccc-4579-823e-ee6d298883d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:32.619113 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88d1d53f-8ccc-4579-823e-ee6d298883d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:32.619113 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88d1d53f-8ccc-4579-823e-ee6d298883d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:32.684484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-88d1d53f-8ccc-4579-823e-ee6d298883d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:32.692096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-88d1d53f-8ccc-4579-823e-ee6d298883d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.087187 Apr 12 15:04:32.692653 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 521/1066] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:32 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:33.708351 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2658fb76-84aa-44cc-9117-92f6f58f2d85 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:33.708958 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2658fb76-84aa-44cc-9117-92f6f58f2d85 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:33.716569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2658fb76-84aa-44cc-9117-92f6f58f2d85 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:33.717017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2658fb76-84aa-44cc-9117-92f6f58f2d85 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:33.717825 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2658fb76-84aa-44cc-9117-92f6f58f2d85 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:33.718256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2658fb76-84aa-44cc-9117-92f6f58f2d85 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:33.777977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2658fb76-84aa-44cc-9117-92f6f58f2d85 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:33.785355 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2658fb76-84aa-44cc-9117-92f6f58f2d85 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080874 Apr 12 15:04:33.785993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 546/1067] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:33 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:34.803034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5f38f140-a8ff-4c36-8372-0bda6539093c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:34.803678 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5f38f140-a8ff-4c36-8372-0bda6539093c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:34.810350 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5f38f140-a8ff-4c36-8372-0bda6539093c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:34.810793 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5f38f140-a8ff-4c36-8372-0bda6539093c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:34.811608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5f38f140-a8ff-4c36-8372-0bda6539093c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:34.812097 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5f38f140-a8ff-4c36-8372-0bda6539093c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:34.872579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5f38f140-a8ff-4c36-8372-0bda6539093c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:34.879846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5f38f140-a8ff-4c36-8372-0bda6539093c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081050 Apr 12 15:04:34.880402 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 522/1068] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:34 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:35.898213 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2a22c2ad-9fb4-46c9-8d54-a53fa0d362f9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:35.898818 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2a22c2ad-9fb4-46c9-8d54-a53fa0d362f9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:35.905170 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a22c2ad-9fb4-46c9-8d54-a53fa0d362f9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:35.905614 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a22c2ad-9fb4-46c9-8d54-a53fa0d362f9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:35.906402 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a22c2ad-9fb4-46c9-8d54-a53fa0d362f9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:35.906831 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2a22c2ad-9fb4-46c9-8d54-a53fa0d362f9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:35.966733 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2a22c2ad-9fb4-46c9-8d54-a53fa0d362f9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:35.974217 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2a22c2ad-9fb4-46c9-8d54-a53fa0d362f9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079791 Apr 12 15:04:35.974782 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 547/1069] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:35 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:36.991564 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ad90d66a-4551-44d6-bb31-dcee4eb2b93c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:36.992177 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ad90d66a-4551-44d6-bb31-dcee4eb2b93c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:36.998752 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad90d66a-4551-44d6-bb31-dcee4eb2b93c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:36.999204 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad90d66a-4551-44d6-bb31-dcee4eb2b93c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:36.999973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad90d66a-4551-44d6-bb31-dcee4eb2b93c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:37.000410 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ad90d66a-4551-44d6-bb31-dcee4eb2b93c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:37.065588 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ad90d66a-4551-44d6-bb31-dcee4eb2b93c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:37.074288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ad90d66a-4551-44d6-bb31-dcee4eb2b93c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086756 Apr 12 15:04:37.074878 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 523/1070] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:36 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:38.091245 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ff454d4b-e9ee-4797-9452-369c6083dde9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:38.091792 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ff454d4b-e9ee-4797-9452-369c6083dde9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:38.098242 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ff454d4b-e9ee-4797-9452-369c6083dde9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:38.098727 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ff454d4b-e9ee-4797-9452-369c6083dde9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:38.099495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ff454d4b-e9ee-4797-9452-369c6083dde9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:38.100061 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ff454d4b-e9ee-4797-9452-369c6083dde9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:38.163849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ff454d4b-e9ee-4797-9452-369c6083dde9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:38.171850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ff454d4b-e9ee-4797-9452-369c6083dde9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085331 Apr 12 15:04:38.172416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 548/1071] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:38 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:39.190610 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f5625d67-19ce-46e4-9022-231d263af500 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:39.191161 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f5625d67-19ce-46e4-9022-231d263af500 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:39.198918 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f5625d67-19ce-46e4-9022-231d263af500 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:39.199374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f5625d67-19ce-46e4-9022-231d263af500 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:39.200174 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f5625d67-19ce-46e4-9022-231d263af500 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:39.200612 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f5625d67-19ce-46e4-9022-231d263af500 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:39.260774 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f5625d67-19ce-46e4-9022-231d263af500 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:39.268817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f5625d67-19ce-46e4-9022-231d263af500 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082500 Apr 12 15:04:39.269387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 524/1072] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:39 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:39.676804 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:04:39.676972 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:04:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:04:40.286172 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bcbcb3c6-3453-4887-b4e0-f7dc9e5ca384 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:40.286867 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bcbcb3c6-3453-4887-b4e0-f7dc9e5ca384 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:40.294456 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcbcb3c6-3453-4887-b4e0-f7dc9e5ca384 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:40.294890 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcbcb3c6-3453-4887-b4e0-f7dc9e5ca384 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:40.295648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcbcb3c6-3453-4887-b4e0-f7dc9e5ca384 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:40.296069 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bcbcb3c6-3453-4887-b4e0-f7dc9e5ca384 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:40.355970 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bcbcb3c6-3453-4887-b4e0-f7dc9e5ca384 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:40.363392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bcbcb3c6-3453-4887-b4e0-f7dc9e5ca384 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081105 Apr 12 15:04:40.363943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 549/1073] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:40 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:41.381492 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9ead9ee2-25a2-4c2c-96cb-53cc80b8f819 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:41.382224 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9ead9ee2-25a2-4c2c-96cb-53cc80b8f819 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:41.388679 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9ead9ee2-25a2-4c2c-96cb-53cc80b8f819 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:41.389123 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9ead9ee2-25a2-4c2c-96cb-53cc80b8f819 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:41.389933 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9ead9ee2-25a2-4c2c-96cb-53cc80b8f819 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:41.390371 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9ead9ee2-25a2-4c2c-96cb-53cc80b8f819 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:41.453992 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9ead9ee2-25a2-4c2c-96cb-53cc80b8f819 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:41.461341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9ead9ee2-25a2-4c2c-96cb-53cc80b8f819 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083772 Apr 12 15:04:41.461943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 525/1074] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:41 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:42.480104 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-efcf8172-d426-4ada-ab74-1c15a845f283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:42.480707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-efcf8172-d426-4ada-ab74-1c15a845f283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:42.487081 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efcf8172-d426-4ada-ab74-1c15a845f283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:42.487524 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efcf8172-d426-4ada-ab74-1c15a845f283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:42.488281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efcf8172-d426-4ada-ab74-1c15a845f283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:42.488707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efcf8172-d426-4ada-ab74-1c15a845f283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:42.552069 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-efcf8172-d426-4ada-ab74-1c15a845f283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:42.561279 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-efcf8172-d426-4ada-ab74-1c15a845f283 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086146 Apr 12 15:04:42.561962 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 550/1075] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:42 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:43.579231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-47332217-bd6f-4d9a-85a4-e240e5330d46 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:43.579837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-47332217-bd6f-4d9a-85a4-e240e5330d46 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:43.586332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47332217-bd6f-4d9a-85a4-e240e5330d46 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:43.586775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47332217-bd6f-4d9a-85a4-e240e5330d46 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:43.588085 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47332217-bd6f-4d9a-85a4-e240e5330d46 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:43.588513 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47332217-bd6f-4d9a-85a4-e240e5330d46 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:43.649125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-47332217-bd6f-4d9a-85a4-e240e5330d46 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:43.657318 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-47332217-bd6f-4d9a-85a4-e240e5330d46 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082040 Apr 12 15:04:43.657926 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 526/1076] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:43 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:44.675371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f94d428c-2de3-4a51-8e92-62e19ec45738 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:44.676126 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f94d428c-2de3-4a51-8e92-62e19ec45738 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:44.682659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f94d428c-2de3-4a51-8e92-62e19ec45738 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:44.683105 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f94d428c-2de3-4a51-8e92-62e19ec45738 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:44.683891 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f94d428c-2de3-4a51-8e92-62e19ec45738 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:44.684326 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f94d428c-2de3-4a51-8e92-62e19ec45738 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:44.746874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f94d428c-2de3-4a51-8e92-62e19ec45738 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:44.754356 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f94d428c-2de3-4a51-8e92-62e19ec45738 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082928 Apr 12 15:04:44.754921 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 551/1077] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:44 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:45.771600 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-df56aad4-b8dd-4caf-8585-48b86742409b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:45.772175 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-df56aad4-b8dd-4caf-8585-48b86742409b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:45.779165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df56aad4-b8dd-4caf-8585-48b86742409b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:45.779618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df56aad4-b8dd-4caf-8585-48b86742409b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:45.780520 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df56aad4-b8dd-4caf-8585-48b86742409b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:45.780899 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-df56aad4-b8dd-4caf-8585-48b86742409b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:45.845024 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-df56aad4-b8dd-4caf-8585-48b86742409b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:45.852458 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-df56aad4-b8dd-4caf-8585-48b86742409b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084755 Apr 12 15:04:45.853028 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 527/1078] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:45 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:46.872825 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-56e9dc4a-ed28-43d9-b359-f7843fc9482b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:46.873383 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-56e9dc4a-ed28-43d9-b359-f7843fc9482b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:46.879780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56e9dc4a-ed28-43d9-b359-f7843fc9482b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:46.880232 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56e9dc4a-ed28-43d9-b359-f7843fc9482b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:46.881007 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56e9dc4a-ed28-43d9-b359-f7843fc9482b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:46.881447 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-56e9dc4a-ed28-43d9-b359-f7843fc9482b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:46.945281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-56e9dc4a-ed28-43d9-b359-f7843fc9482b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:46.954174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-56e9dc4a-ed28-43d9-b359-f7843fc9482b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085181 Apr 12 15:04:46.954914 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 552/1079] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:46 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:47.974518 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-77536250-81cf-4ff7-9fe2-2ea9c403a2bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:47.975576 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-77536250-81cf-4ff7-9fe2-2ea9c403a2bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:47.986483 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-77536250-81cf-4ff7-9fe2-2ea9c403a2bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:47.987175 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-77536250-81cf-4ff7-9fe2-2ea9c403a2bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:47.988406 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-77536250-81cf-4ff7-9fe2-2ea9c403a2bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:47.989105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-77536250-81cf-4ff7-9fe2-2ea9c403a2bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:48.058984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-77536250-81cf-4ff7-9fe2-2ea9c403a2bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:48.067438 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-77536250-81cf-4ff7-9fe2-2ea9c403a2bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.099414 Apr 12 15:04:48.068017 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 528/1080] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:47 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:49.085937 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a46461ee-2949-4035-bb41-ca9bc0e18169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:49.086536 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a46461ee-2949-4035-bb41-ca9bc0e18169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:49.094162 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a46461ee-2949-4035-bb41-ca9bc0e18169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:49.094604 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a46461ee-2949-4035-bb41-ca9bc0e18169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:49.095377 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a46461ee-2949-4035-bb41-ca9bc0e18169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:49.095804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a46461ee-2949-4035-bb41-ca9bc0e18169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:49.193415 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a46461ee-2949-4035-bb41-ca9bc0e18169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:49.201153 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a46461ee-2949-4035-bb41-ca9bc0e18169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.119183 Apr 12 15:04:49.201746 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 553/1081] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:49 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:50.218963 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2c02f038-7ffb-4393-9204-cecdc2918a63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:50.219637 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2c02f038-7ffb-4393-9204-cecdc2918a63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:50.225961 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c02f038-7ffb-4393-9204-cecdc2918a63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:50.226405 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c02f038-7ffb-4393-9204-cecdc2918a63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:50.227160 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c02f038-7ffb-4393-9204-cecdc2918a63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:50.228168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2c02f038-7ffb-4393-9204-cecdc2918a63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:50.289725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2c02f038-7ffb-4393-9204-cecdc2918a63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:50.299574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2c02f038-7ffb-4393-9204-cecdc2918a63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084572 Apr 12 15:04:50.300143 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 529/1082] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:50 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:51.316517 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0142a700-ec1e-4c0a-b6e8-6e653f2bab3b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:51.317124 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0142a700-ec1e-4c0a-b6e8-6e653f2bab3b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:51.323829 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0142a700-ec1e-4c0a-b6e8-6e653f2bab3b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:51.324279 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0142a700-ec1e-4c0a-b6e8-6e653f2bab3b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:51.325054 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0142a700-ec1e-4c0a-b6e8-6e653f2bab3b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:51.325491 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0142a700-ec1e-4c0a-b6e8-6e653f2bab3b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:51.385269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0142a700-ec1e-4c0a-b6e8-6e653f2bab3b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:51.392742 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0142a700-ec1e-4c0a-b6e8-6e653f2bab3b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080083 Apr 12 15:04:51.393304 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 554/1083] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:51 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:52.409912 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-91be349b-779f-4f52-8d73-2225a93018ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:52.410567 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-91be349b-779f-4f52-8d73-2225a93018ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:52.417674 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91be349b-779f-4f52-8d73-2225a93018ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:52.418058 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91be349b-779f-4f52-8d73-2225a93018ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:52.418816 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91be349b-779f-4f52-8d73-2225a93018ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:52.419245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-91be349b-779f-4f52-8d73-2225a93018ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:52.479913 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-91be349b-779f-4f52-8d73-2225a93018ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:52.487352 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-91be349b-779f-4f52-8d73-2225a93018ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081458 Apr 12 15:04:52.487916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 530/1084] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:52 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:53.505121 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4a5eca01-b6c9-4ee2-b443-24351e3c741e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:53.505674 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4a5eca01-b6c9-4ee2-b443-24351e3c741e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:53.512700 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a5eca01-b6c9-4ee2-b443-24351e3c741e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:53.513152 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a5eca01-b6c9-4ee2-b443-24351e3c741e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:53.513965 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a5eca01-b6c9-4ee2-b443-24351e3c741e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:53.514400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4a5eca01-b6c9-4ee2-b443-24351e3c741e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:53.580429 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4a5eca01-b6c9-4ee2-b443-24351e3c741e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:53.588097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4a5eca01-b6c9-4ee2-b443-24351e3c741e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.087154 Apr 12 15:04:53.588663 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 555/1085] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:53 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:54.605172 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-40d2fb1c-4271-462a-b989-b4b2398fd94e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:54.605805 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-40d2fb1c-4271-462a-b989-b4b2398fd94e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:54.612174 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-40d2fb1c-4271-462a-b989-b4b2398fd94e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:54.612618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-40d2fb1c-4271-462a-b989-b4b2398fd94e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:54.613383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-40d2fb1c-4271-462a-b989-b4b2398fd94e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:54.613854 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-40d2fb1c-4271-462a-b989-b4b2398fd94e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:54.651521 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:04:54.651775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:04:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 (ip 10.222.0.64) !!! Apr 12 15:04:54.681611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-40d2fb1c-4271-462a-b989-b4b2398fd94e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:54.688234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-40d2fb1c-4271-462a-b989-b4b2398fd94e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.087648 Apr 12 15:04:54.688808 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 531/1086] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:54 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:55.705962 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ad512c23-9fc5-400e-b7d3-d640364e34a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:55.706575 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ad512c23-9fc5-400e-b7d3-d640364e34a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:55.712663 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad512c23-9fc5-400e-b7d3-d640364e34a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:55.713109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad512c23-9fc5-400e-b7d3-d640364e34a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:55.713908 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad512c23-9fc5-400e-b7d3-d640364e34a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:55.714343 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ad512c23-9fc5-400e-b7d3-d640364e34a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:55.774461 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ad512c23-9fc5-400e-b7d3-d640364e34a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:55.781946 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ad512c23-9fc5-400e-b7d3-d640364e34a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080381 Apr 12 15:04:55.782583 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 556/1087] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:55 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:56.798128 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bc3ca1f4-e68e-4536-a1b2-1cb611a16598 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:56.798760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bc3ca1f4-e68e-4536-a1b2-1cb611a16598 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:56.805140 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bc3ca1f4-e68e-4536-a1b2-1cb611a16598 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:56.806607 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bc3ca1f4-e68e-4536-a1b2-1cb611a16598 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:56.807384 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bc3ca1f4-e68e-4536-a1b2-1cb611a16598 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:56.807812 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bc3ca1f4-e68e-4536-a1b2-1cb611a16598 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:56.867665 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bc3ca1f4-e68e-4536-a1b2-1cb611a16598 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:56.875810 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bc3ca1f4-e68e-4536-a1b2-1cb611a16598 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081561 Apr 12 15:04:56.876374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 532/1088] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:56 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:04:57.893209 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8244fbea-1e35-4f60-bd1c-ec4ab82cf33c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:57.893884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8244fbea-1e35-4f60-bd1c-ec4ab82cf33c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:57.900681 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8244fbea-1e35-4f60-bd1c-ec4ab82cf33c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:57.901141 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8244fbea-1e35-4f60-bd1c-ec4ab82cf33c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:57.901952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8244fbea-1e35-4f60-bd1c-ec4ab82cf33c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:57.902388 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8244fbea-1e35-4f60-bd1c-ec4ab82cf33c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:57.963584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8244fbea-1e35-4f60-bd1c-ec4ab82cf33c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:57.971913 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8244fbea-1e35-4f60-bd1c-ec4ab82cf33c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082798 Apr 12 15:04:57.972487 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 557/1089] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:57 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:04:58.989907 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9dc5e6a0-c68d-4755-acd4-795eb44098f7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:04:58.990963 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9dc5e6a0-c68d-4755-acd4-795eb44098f7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:04:58.998841 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9dc5e6a0-c68d-4755-acd4-795eb44098f7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:58.999614 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9dc5e6a0-c68d-4755-acd4-795eb44098f7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:59.000458 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9dc5e6a0-c68d-4755-acd4-795eb44098f7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:04:59.000897 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9dc5e6a0-c68d-4755-acd4-795eb44098f7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:04:59.074922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9dc5e6a0-c68d-4755-acd4-795eb44098f7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:04:59.085383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9dc5e6a0-c68d-4755-acd4-795eb44098f7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.099473 Apr 12 15:04:59.086041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 533/1090] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:04:58 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:00.104675 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2ae1d386-8b7c-4f00-b9fd-cf3511a6ea73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:00.105288 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2ae1d386-8b7c-4f00-b9fd-cf3511a6ea73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:00.112461 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ae1d386-8b7c-4f00-b9fd-cf3511a6ea73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:00.113146 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ae1d386-8b7c-4f00-b9fd-cf3511a6ea73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:00.113714 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ae1d386-8b7c-4f00-b9fd-cf3511a6ea73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:00.114159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ae1d386-8b7c-4f00-b9fd-cf3511a6ea73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:00.174396 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2ae1d386-8b7c-4f00-b9fd-cf3511a6ea73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:00.182240 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2ae1d386-8b7c-4f00-b9fd-cf3511a6ea73 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081598 Apr 12 15:05:00.183034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 558/1091] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:00 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:05:01.200083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-369971b8-9a75-4935-8024-71fd380a1116 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:01.200703 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-369971b8-9a75-4935-8024-71fd380a1116 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:01.207033 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-369971b8-9a75-4935-8024-71fd380a1116 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:01.207495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-369971b8-9a75-4935-8024-71fd380a1116 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:01.208270 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-369971b8-9a75-4935-8024-71fd380a1116 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:01.208737 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-369971b8-9a75-4935-8024-71fd380a1116 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:01.273262 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-369971b8-9a75-4935-8024-71fd380a1116 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:01.278711 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-369971b8-9a75-4935-8024-71fd380a1116 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083147 Apr 12 15:05:01.279509 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 534/1092] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:01 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:02.296968 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-02dde56d-88c8-4171-8cb0-a82863dd83bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:02.297566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-02dde56d-88c8-4171-8cb0-a82863dd83bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:02.303922 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-02dde56d-88c8-4171-8cb0-a82863dd83bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:02.304375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-02dde56d-88c8-4171-8cb0-a82863dd83bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:02.305145 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-02dde56d-88c8-4171-8cb0-a82863dd83bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:02.305913 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-02dde56d-88c8-4171-8cb0-a82863dd83bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:02.367217 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-02dde56d-88c8-4171-8cb0-a82863dd83bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:02.375108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-02dde56d-88c8-4171-8cb0-a82863dd83bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082022 Apr 12 15:05:02.375665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 559/1093] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:02 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:03.395530 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-955eb731-8cff-4ada-854f-2a9b7acbadee tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:03.396090 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-955eb731-8cff-4ada-854f-2a9b7acbadee tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:03.403079 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-955eb731-8cff-4ada-854f-2a9b7acbadee tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:03.403508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-955eb731-8cff-4ada-854f-2a9b7acbadee tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:03.404277 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-955eb731-8cff-4ada-854f-2a9b7acbadee tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:03.404706 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-955eb731-8cff-4ada-854f-2a9b7acbadee tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:03.475196 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-955eb731-8cff-4ada-854f-2a9b7acbadee tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:03.483978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-955eb731-8cff-4ada-854f-2a9b7acbadee tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.094978 Apr 12 15:05:03.484550 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 535/1094] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:03 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:05:04.502411 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e628fdf2-d931-4499-98c0-b1a29582ea8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:04.503017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e628fdf2-d931-4499-98c0-b1a29582ea8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:04.510187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e628fdf2-d931-4499-98c0-b1a29582ea8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:04.510635 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e628fdf2-d931-4499-98c0-b1a29582ea8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:04.511418 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e628fdf2-d931-4499-98c0-b1a29582ea8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:04.511853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e628fdf2-d931-4499-98c0-b1a29582ea8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:04.575549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e628fdf2-d931-4499-98c0-b1a29582ea8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:04.583447 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e628fdf2-d931-4499-98c0-b1a29582ea8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085393 Apr 12 15:05:04.584019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 560/1095] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:04 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:05.602714 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d85859ec-db51-474d-979a-c5d730653950 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:05.603418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d85859ec-db51-474d-979a-c5d730653950 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:05.609998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85859ec-db51-474d-979a-c5d730653950 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:05.610447 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85859ec-db51-474d-979a-c5d730653950 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:05.611221 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85859ec-db51-474d-979a-c5d730653950 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:05.611652 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85859ec-db51-474d-979a-c5d730653950 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:05.672785 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d85859ec-db51-474d-979a-c5d730653950 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:05.681135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d85859ec-db51-474d-979a-c5d730653950 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082267 Apr 12 15:05:05.681733 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 536/1096] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:05 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:05:06.698550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b8227499-b6af-4399-a890-0e3e9538026c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:06.699157 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b8227499-b6af-4399-a890-0e3e9538026c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:06.705607 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8227499-b6af-4399-a890-0e3e9538026c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:06.706089 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8227499-b6af-4399-a890-0e3e9538026c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:06.706937 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8227499-b6af-4399-a890-0e3e9538026c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:06.707407 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8227499-b6af-4399-a890-0e3e9538026c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:06.774229 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b8227499-b6af-4399-a890-0e3e9538026c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:06.784152 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b8227499-b6af-4399-a890-0e3e9538026c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.090104 Apr 12 15:05:06.785086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 561/1097] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:06 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:07.801371 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-21f2fa39-9007-4d61-a9e0-ed6cb82fb164 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:07.802034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-21f2fa39-9007-4d61-a9e0-ed6cb82fb164 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:07.808432 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-21f2fa39-9007-4d61-a9e0-ed6cb82fb164 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:07.808871 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-21f2fa39-9007-4d61-a9e0-ed6cb82fb164 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:07.809655 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-21f2fa39-9007-4d61-a9e0-ed6cb82fb164 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:07.810108 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-21f2fa39-9007-4d61-a9e0-ed6cb82fb164 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:07.874719 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-21f2fa39-9007-4d61-a9e0-ed6cb82fb164 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:07.882083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-21f2fa39-9007-4d61-a9e0-ed6cb82fb164 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084543 Apr 12 15:05:07.882653 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 537/1098] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:07 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:08.900514 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-80f00c98-3ba0-4567-9fba-0beaa711cb6e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:08.901094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-80f00c98-3ba0-4567-9fba-0beaa711cb6e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:08.907473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80f00c98-3ba0-4567-9fba-0beaa711cb6e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:08.907917 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80f00c98-3ba0-4567-9fba-0beaa711cb6e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:08.908700 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80f00c98-3ba0-4567-9fba-0beaa711cb6e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:08.909137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-80f00c98-3ba0-4567-9fba-0beaa711cb6e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:08.974517 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-80f00c98-3ba0-4567-9fba-0beaa711cb6e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:08.982952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-80f00c98-3ba0-4567-9fba-0beaa711cb6e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086557 Apr 12 15:05:08.983533 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 562/1099] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:08 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:09.999966 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c97efcde-6f09-4424-8540-f2c2dd8c2b39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:10.000588 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c97efcde-6f09-4424-8540-f2c2dd8c2b39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:10.006771 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c97efcde-6f09-4424-8540-f2c2dd8c2b39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:10.007220 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c97efcde-6f09-4424-8540-f2c2dd8c2b39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:10.007991 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c97efcde-6f09-4424-8540-f2c2dd8c2b39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:10.009251 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c97efcde-6f09-4424-8540-f2c2dd8c2b39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:10.069975 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c97efcde-6f09-4424-8540-f2c2dd8c2b39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:10.078440 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c97efcde-6f09-4424-8540-f2c2dd8c2b39 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082356 Apr 12 15:05:10.079053 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 538/1100] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:09 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:05:11.095990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a4b36c54-bc02-4e8b-99ab-5d942c0d9e80 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:11.096588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a4b36c54-bc02-4e8b-99ab-5d942c0d9e80 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:11.103055 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4b36c54-bc02-4e8b-99ab-5d942c0d9e80 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:11.103501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4b36c54-bc02-4e8b-99ab-5d942c0d9e80 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:11.104259 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4b36c54-bc02-4e8b-99ab-5d942c0d9e80 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:11.104683 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4b36c54-bc02-4e8b-99ab-5d942c0d9e80 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:11.168390 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a4b36c54-bc02-4e8b-99ab-5d942c0d9e80 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:11.175618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a4b36c54-bc02-4e8b-99ab-5d942c0d9e80 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083668 Apr 12 15:05:11.186957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 563/1101] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:11 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:12.194426 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f18bc29f-91da-4da7-8125-0fb8135d497b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:12.195031 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f18bc29f-91da-4da7-8125-0fb8135d497b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:12.202170 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f18bc29f-91da-4da7-8125-0fb8135d497b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:12.202612 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f18bc29f-91da-4da7-8125-0fb8135d497b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:12.203385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f18bc29f-91da-4da7-8125-0fb8135d497b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:12.206085 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f18bc29f-91da-4da7-8125-0fb8135d497b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:12.294665 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f18bc29f-91da-4da7-8125-0fb8135d497b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:12.302625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f18bc29f-91da-4da7-8125-0fb8135d497b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.112043 Apr 12 15:05:12.303187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 539/1102] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:12 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:05:13.321547 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-23dbf6eb-adbc-4b43-bc3e-7a44236b4ddc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:13.322399 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-23dbf6eb-adbc-4b43-bc3e-7a44236b4ddc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:13.330834 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-23dbf6eb-adbc-4b43-bc3e-7a44236b4ddc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:13.331365 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-23dbf6eb-adbc-4b43-bc3e-7a44236b4ddc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:13.332216 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-23dbf6eb-adbc-4b43-bc3e-7a44236b4ddc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:13.332738 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-23dbf6eb-adbc-4b43-bc3e-7a44236b4ddc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:13.393582 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-23dbf6eb-adbc-4b43-bc3e-7a44236b4ddc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:13.401588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-23dbf6eb-adbc-4b43-bc3e-7a44236b4ddc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084946 Apr 12 15:05:13.402176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 564/1103] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:13 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:14.419280 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-80f6c26e-c1fd-4bd7-98c9-d1a81809d731 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:14.419893 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-80f6c26e-c1fd-4bd7-98c9-d1a81809d731 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:14.426430 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80f6c26e-c1fd-4bd7-98c9-d1a81809d731 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:14.426878 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80f6c26e-c1fd-4bd7-98c9-d1a81809d731 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:14.427659 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80f6c26e-c1fd-4bd7-98c9-d1a81809d731 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:14.428095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80f6c26e-c1fd-4bd7-98c9-d1a81809d731 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:14.491293 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-80f6c26e-c1fd-4bd7-98c9-d1a81809d731 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:14.500004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-80f6c26e-c1fd-4bd7-98c9-d1a81809d731 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085434 Apr 12 15:05:14.500578 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 540/1104] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:14 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:15.517464 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-50e1dc54-db5c-4892-a31b-2a91bfedf705 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:15.518093 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-50e1dc54-db5c-4892-a31b-2a91bfedf705 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:15.524408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50e1dc54-db5c-4892-a31b-2a91bfedf705 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:15.524847 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50e1dc54-db5c-4892-a31b-2a91bfedf705 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:15.526004 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50e1dc54-db5c-4892-a31b-2a91bfedf705 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:15.526450 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-50e1dc54-db5c-4892-a31b-2a91bfedf705 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:15.600552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-50e1dc54-db5c-4892-a31b-2a91bfedf705 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:15.608508 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-50e1dc54-db5c-4892-a31b-2a91bfedf705 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.094877 Apr 12 15:05:15.609089 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 565/1105] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:15 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:16.625917 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-49e5ba03-39c9-42bc-89ec-a4a1e16e872e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:16.626479 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-49e5ba03-39c9-42bc-89ec-a4a1e16e872e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:16.632789 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-49e5ba03-39c9-42bc-89ec-a4a1e16e872e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:16.633238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-49e5ba03-39c9-42bc-89ec-a4a1e16e872e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:16.634079 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-49e5ba03-39c9-42bc-89ec-a4a1e16e872e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:16.634571 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-49e5ba03-39c9-42bc-89ec-a4a1e16e872e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:16.702930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-49e5ba03-39c9-42bc-89ec-a4a1e16e872e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:16.711192 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-49e5ba03-39c9-42bc-89ec-a4a1e16e872e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.089256 Apr 12 15:05:16.711776 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 541/1106] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:16 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:17.730131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e83fbd56-94fd-4e2b-ae8d-86954df4d08b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:17.730872 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e83fbd56-94fd-4e2b-ae8d-86954df4d08b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:17.740067 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e83fbd56-94fd-4e2b-ae8d-86954df4d08b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:17.740772 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e83fbd56-94fd-4e2b-ae8d-86954df4d08b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:17.741976 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e83fbd56-94fd-4e2b-ae8d-86954df4d08b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:17.742640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e83fbd56-94fd-4e2b-ae8d-86954df4d08b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:17.806175 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e83fbd56-94fd-4e2b-ae8d-86954df4d08b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:17.814131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e83fbd56-94fd-4e2b-ae8d-86954df4d08b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.089365 Apr 12 15:05:17.814692 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 566/1107] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:17 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:18.831471 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-37b0c4ab-46f2-48b4-ae38-2e6746691682 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:18.832075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-37b0c4ab-46f2-48b4-ae38-2e6746691682 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:18.839599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37b0c4ab-46f2-48b4-ae38-2e6746691682 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:18.840044 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37b0c4ab-46f2-48b4-ae38-2e6746691682 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:18.840802 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37b0c4ab-46f2-48b4-ae38-2e6746691682 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:18.841230 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-37b0c4ab-46f2-48b4-ae38-2e6746691682 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:18.903022 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-37b0c4ab-46f2-48b4-ae38-2e6746691682 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:18.910384 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-37b0c4ab-46f2-48b4-ae38-2e6746691682 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082841 Apr 12 15:05:18.910951 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 542/1108] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:18 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:19.928426 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-be2d8345-21d8-40fb-9f0a-e23e115d45a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:19.929031 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-be2d8345-21d8-40fb-9f0a-e23e115d45a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:19.936363 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be2d8345-21d8-40fb-9f0a-e23e115d45a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:19.936804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be2d8345-21d8-40fb-9f0a-e23e115d45a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:19.937590 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be2d8345-21d8-40fb-9f0a-e23e115d45a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:19.938043 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-be2d8345-21d8-40fb-9f0a-e23e115d45a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:19.998651 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-be2d8345-21d8-40fb-9f0a-e23e115d45a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:20.006064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-be2d8345-21d8-40fb-9f0a-e23e115d45a6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081657 Apr 12 15:05:20.006621 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 567/1109] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:19 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:21.023562 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-44f9bbaf-3009-4555-b7ee-1b8d8ef9b9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:21.024147 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-44f9bbaf-3009-4555-b7ee-1b8d8ef9b9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:21.031822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-44f9bbaf-3009-4555-b7ee-1b8d8ef9b9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:21.031822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-44f9bbaf-3009-4555-b7ee-1b8d8ef9b9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:21.031822 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-44f9bbaf-3009-4555-b7ee-1b8d8ef9b9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:21.032227 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-44f9bbaf-3009-4555-b7ee-1b8d8ef9b9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:21.096516 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-44f9bbaf-3009-4555-b7ee-1b8d8ef9b9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:21.104519 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-44f9bbaf-3009-4555-b7ee-1b8d8ef9b9c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084776 Apr 12 15:05:21.105089 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 543/1110] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:21 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:05:22.122961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-60d0e02c-24fb-441d-9a56-fb1e2f75a397 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:22.123516 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-60d0e02c-24fb-441d-9a56-fb1e2f75a397 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:22.129384 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60d0e02c-24fb-441d-9a56-fb1e2f75a397 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:22.129879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60d0e02c-24fb-441d-9a56-fb1e2f75a397 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:22.130774 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60d0e02c-24fb-441d-9a56-fb1e2f75a397 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:22.131081 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60d0e02c-24fb-441d-9a56-fb1e2f75a397 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:22.190648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-60d0e02c-24fb-441d-9a56-fb1e2f75a397 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:22.198181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-60d0e02c-24fb-441d-9a56-fb1e2f75a397 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080423 Apr 12 15:05:22.198748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 568/1111] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:22 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:23.215077 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3564c562-221d-4501-9f7b-71c9ed609465 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:23.215685 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3564c562-221d-4501-9f7b-71c9ed609465 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:23.221987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3564c562-221d-4501-9f7b-71c9ed609465 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:23.222427 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3564c562-221d-4501-9f7b-71c9ed609465 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:23.223193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3564c562-221d-4501-9f7b-71c9ed609465 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:23.223620 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3564c562-221d-4501-9f7b-71c9ed609465 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:23.284257 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3564c562-221d-4501-9f7b-71c9ed609465 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:23.292239 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3564c562-221d-4501-9f7b-71c9ed609465 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081754 Apr 12 15:05:23.292796 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 544/1112] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:23 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:24.310490 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b1b51600-c598-4a33-b31a-406a65c37140 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:24.311391 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b1b51600-c598-4a33-b31a-406a65c37140 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:24.317723 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1b51600-c598-4a33-b31a-406a65c37140 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:24.318177 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1b51600-c598-4a33-b31a-406a65c37140 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:24.318942 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1b51600-c598-4a33-b31a-406a65c37140 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:24.319372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1b51600-c598-4a33-b31a-406a65c37140 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:24.381532 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b1b51600-c598-4a33-b31a-406a65c37140 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:24.389169 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b1b51600-c598-4a33-b31a-406a65c37140 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083414 Apr 12 15:05:24.389766 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 569/1113] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:24 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:25.406387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-de8764ab-1716-4a8a-b36a-16c86b073d1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:25.407013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-de8764ab-1716-4a8a-b36a-16c86b073d1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:25.413364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de8764ab-1716-4a8a-b36a-16c86b073d1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:25.413874 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de8764ab-1716-4a8a-b36a-16c86b073d1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:25.414651 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de8764ab-1716-4a8a-b36a-16c86b073d1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:25.415086 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-de8764ab-1716-4a8a-b36a-16c86b073d1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:25.476444 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-de8764ab-1716-4a8a-b36a-16c86b073d1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:25.484289 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-de8764ab-1716-4a8a-b36a-16c86b073d1b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081875 Apr 12 15:05:25.484851 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 545/1114] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:25 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:26.501210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-35fabdb4-81d5-4b43-9254-decbf47f53ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:26.502256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-35fabdb4-81d5-4b43-9254-decbf47f53ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:26.510098 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35fabdb4-81d5-4b43-9254-decbf47f53ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:26.510549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35fabdb4-81d5-4b43-9254-decbf47f53ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:26.511325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35fabdb4-81d5-4b43-9254-decbf47f53ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:26.511759 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-35fabdb4-81d5-4b43-9254-decbf47f53ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:26.571523 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-35fabdb4-81d5-4b43-9254-decbf47f53ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:26.579380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-35fabdb4-81d5-4b43-9254-decbf47f53ff tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082243 Apr 12 15:05:26.579936 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 570/1115] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:26 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:27.597139 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f97a5162-2a19-4f63-af09-eeb0a04de392 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:27.597810 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f97a5162-2a19-4f63-af09-eeb0a04de392 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:27.604646 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f97a5162-2a19-4f63-af09-eeb0a04de392 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:27.605100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f97a5162-2a19-4f63-af09-eeb0a04de392 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:27.605906 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f97a5162-2a19-4f63-af09-eeb0a04de392 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:27.606343 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f97a5162-2a19-4f63-af09-eeb0a04de392 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:27.665336 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f97a5162-2a19-4f63-af09-eeb0a04de392 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:27.673461 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f97a5162-2a19-4f63-af09-eeb0a04de392 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080164 Apr 12 15:05:27.674056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 546/1116] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:27 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:28.690245 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-206079c0-4dcd-4321-a0a6-011ee888a5da tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:28.690849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-206079c0-4dcd-4321-a0a6-011ee888a5da tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:28.698045 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-206079c0-4dcd-4321-a0a6-011ee888a5da tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:28.698588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-206079c0-4dcd-4321-a0a6-011ee888a5da tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:28.699370 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-206079c0-4dcd-4321-a0a6-011ee888a5da tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:28.699797 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-206079c0-4dcd-4321-a0a6-011ee888a5da tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:28.758804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-206079c0-4dcd-4321-a0a6-011ee888a5da tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:28.766652 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-206079c0-4dcd-4321-a0a6-011ee888a5da tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080631 Apr 12 15:05:28.767220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 571/1117] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:28 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:29.782970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dfd0f3cf-94cd-4a80-9c51-cf6be721379a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:29.783530 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dfd0f3cf-94cd-4a80-9c51-cf6be721379a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:29.789718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfd0f3cf-94cd-4a80-9c51-cf6be721379a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:29.790169 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfd0f3cf-94cd-4a80-9c51-cf6be721379a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:29.790922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfd0f3cf-94cd-4a80-9c51-cf6be721379a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:29.791350 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfd0f3cf-94cd-4a80-9c51-cf6be721379a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:29.854319 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dfd0f3cf-94cd-4a80-9c51-cf6be721379a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:29.861758 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dfd0f3cf-94cd-4a80-9c51-cf6be721379a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082690 Apr 12 15:05:29.862321 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 547/1118] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:29 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:30.878690 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-87b6d91c-a095-4b4f-9308-3274361f36f6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:30.879239 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-87b6d91c-a095-4b4f-9308-3274361f36f6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:30.886457 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87b6d91c-a095-4b4f-9308-3274361f36f6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:30.886900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87b6d91c-a095-4b4f-9308-3274361f36f6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:30.887659 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87b6d91c-a095-4b4f-9308-3274361f36f6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:30.888086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87b6d91c-a095-4b4f-9308-3274361f36f6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:30.948157 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-87b6d91c-a095-4b4f-9308-3274361f36f6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:30.955375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-87b6d91c-a095-4b4f-9308-3274361f36f6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080690 Apr 12 15:05:30.955925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 572/1119] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:30 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:31.973079 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ba8ecfcc-dfc4-4249-8ccd-6984aad8f67e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:31.973662 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ba8ecfcc-dfc4-4249-8ccd-6984aad8f67e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:31.980493 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ba8ecfcc-dfc4-4249-8ccd-6984aad8f67e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:31.980936 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ba8ecfcc-dfc4-4249-8ccd-6984aad8f67e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:31.981734 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ba8ecfcc-dfc4-4249-8ccd-6984aad8f67e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:31.982172 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ba8ecfcc-dfc4-4249-8ccd-6984aad8f67e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:32.042929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ba8ecfcc-dfc4-4249-8ccd-6984aad8f67e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:32.050186 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ba8ecfcc-dfc4-4249-8ccd-6984aad8f67e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081107 Apr 12 15:05:32.050750 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 548/1120] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:31 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:33.066761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a1641d63-5ac8-4505-9e94-3b596cd8cb6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:33.067364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a1641d63-5ac8-4505-9e94-3b596cd8cb6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:33.074491 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a1641d63-5ac8-4505-9e94-3b596cd8cb6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:33.074936 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a1641d63-5ac8-4505-9e94-3b596cd8cb6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:33.075695 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a1641d63-5ac8-4505-9e94-3b596cd8cb6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:33.076123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a1641d63-5ac8-4505-9e94-3b596cd8cb6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:33.138128 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a1641d63-5ac8-4505-9e94-3b596cd8cb6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:33.145433 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a1641d63-5ac8-4505-9e94-3b596cd8cb6d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082484 Apr 12 15:05:33.146037 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 573/1121] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:33 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:34.162364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d4a18323-f326-4b0d-bb6e-d645cb18caec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:34.162971 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d4a18323-f326-4b0d-bb6e-d645cb18caec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:34.169231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4a18323-f326-4b0d-bb6e-d645cb18caec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:34.169717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4a18323-f326-4b0d-bb6e-d645cb18caec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:34.170485 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4a18323-f326-4b0d-bb6e-d645cb18caec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:34.170922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d4a18323-f326-4b0d-bb6e-d645cb18caec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:34.236603 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d4a18323-f326-4b0d-bb6e-d645cb18caec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:34.244253 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d4a18323-f326-4b0d-bb6e-d645cb18caec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085502 Apr 12 15:05:34.244834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 549/1122] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:34 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:35.261254 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a7329a8b-5ab4-45a0-83ff-2c714cf8a08d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:35.262360 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a7329a8b-5ab4-45a0-83ff-2c714cf8a08d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:35.268479 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7329a8b-5ab4-45a0-83ff-2c714cf8a08d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:35.268935 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7329a8b-5ab4-45a0-83ff-2c714cf8a08d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:35.269737 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7329a8b-5ab4-45a0-83ff-2c714cf8a08d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:35.270176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7329a8b-5ab4-45a0-83ff-2c714cf8a08d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:35.333118 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a7329a8b-5ab4-45a0-83ff-2c714cf8a08d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:35.340701 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a7329a8b-5ab4-45a0-83ff-2c714cf8a08d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083573 Apr 12 15:05:35.345295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 574/1123] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:35 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:05:36.356719 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a9b80751-ae0f-4149-afc1-b8bb104b0f76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:36.357420 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a9b80751-ae0f-4149-afc1-b8bb104b0f76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:36.363592 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a9b80751-ae0f-4149-afc1-b8bb104b0f76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:36.364041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a9b80751-ae0f-4149-afc1-b8bb104b0f76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:36.364811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a9b80751-ae0f-4149-afc1-b8bb104b0f76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:36.365296 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a9b80751-ae0f-4149-afc1-b8bb104b0f76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:36.426120 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a9b80751-ae0f-4149-afc1-b8bb104b0f76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:36.434172 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a9b80751-ae0f-4149-afc1-b8bb104b0f76 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081918 Apr 12 15:05:36.434735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 550/1124] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:36 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:37.451596 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d4b29833-1f98-4f9a-9275-50fd20f774b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:37.452498 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d4b29833-1f98-4f9a-9275-50fd20f774b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:37.458386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4b29833-1f98-4f9a-9275-50fd20f774b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:37.458841 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4b29833-1f98-4f9a-9275-50fd20f774b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:37.459726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4b29833-1f98-4f9a-9275-50fd20f774b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:37.460479 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4b29833-1f98-4f9a-9275-50fd20f774b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:37.523194 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d4b29833-1f98-4f9a-9275-50fd20f774b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:37.530861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d4b29833-1f98-4f9a-9275-50fd20f774b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083098 Apr 12 15:05:37.531436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 575/1125] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:37 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:38.548685 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b85e5bb3-7c0f-41f4-8759-7c2865a6833b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:38.549287 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b85e5bb3-7c0f-41f4-8759-7c2865a6833b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:38.555604 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b85e5bb3-7c0f-41f4-8759-7c2865a6833b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:38.556048 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b85e5bb3-7c0f-41f4-8759-7c2865a6833b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:38.556888 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b85e5bb3-7c0f-41f4-8759-7c2865a6833b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:38.557460 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b85e5bb3-7c0f-41f4-8759-7c2865a6833b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:38.622941 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b85e5bb3-7c0f-41f4-8759-7c2865a6833b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:38.630709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b85e5bb3-7c0f-41f4-8759-7c2865a6833b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086272 Apr 12 15:05:38.631269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 551/1126] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:38 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:39.647834 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ea9a7c3e-1417-475f-a984-6eb58b86ffd0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:39.648435 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ea9a7c3e-1417-475f-a984-6eb58b86ffd0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:39.655374 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea9a7c3e-1417-475f-a984-6eb58b86ffd0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:39.655815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea9a7c3e-1417-475f-a984-6eb58b86ffd0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:39.656563 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea9a7c3e-1417-475f-a984-6eb58b86ffd0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:39.656986 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea9a7c3e-1417-475f-a984-6eb58b86ffd0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:39.716475 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ea9a7c3e-1417-475f-a984-6eb58b86ffd0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:39.724179 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ea9a7c3e-1417-475f-a984-6eb58b86ffd0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080122 Apr 12 15:05:39.724749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 576/1127] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:39 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:40.741877 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3e66e086-0c4d-4af1-a559-bd70476f240f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:40.742488 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3e66e086-0c4d-4af1-a559-bd70476f240f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:40.749623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e66e086-0c4d-4af1-a559-bd70476f240f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:40.750052 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e66e086-0c4d-4af1-a559-bd70476f240f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:40.750815 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e66e086-0c4d-4af1-a559-bd70476f240f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:40.751246 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3e66e086-0c4d-4af1-a559-bd70476f240f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:40.810918 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3e66e086-0c4d-4af1-a559-bd70476f240f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:40.818208 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3e66e086-0c4d-4af1-a559-bd70476f240f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080324 Apr 12 15:05:40.818760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 552/1128] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:40 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:41.835439 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5c8edced-5f6d-4adb-85cf-2e51e3b3b46d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:41.835991 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5c8edced-5f6d-4adb-85cf-2e51e3b3b46d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:41.843947 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5c8edced-5f6d-4adb-85cf-2e51e3b3b46d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:41.844392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5c8edced-5f6d-4adb-85cf-2e51e3b3b46d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:41.845160 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5c8edced-5f6d-4adb-85cf-2e51e3b3b46d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:41.845586 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5c8edced-5f6d-4adb-85cf-2e51e3b3b46d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:41.908213 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5c8edced-5f6d-4adb-85cf-2e51e3b3b46d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:41.915499 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5c8edced-5f6d-4adb-85cf-2e51e3b3b46d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084000 Apr 12 15:05:41.916058 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 577/1129] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:41 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:42.933187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2b5b9829-1540-4295-b952-44003f89e816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:42.933744 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2b5b9829-1540-4295-b952-44003f89e816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:42.940528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2b5b9829-1540-4295-b952-44003f89e816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:42.940978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2b5b9829-1540-4295-b952-44003f89e816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:42.941811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2b5b9829-1540-4295-b952-44003f89e816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:42.942241 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2b5b9829-1540-4295-b952-44003f89e816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:43.004296 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2b5b9829-1540-4295-b952-44003f89e816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:43.011875 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2b5b9829-1540-4295-b952-44003f89e816 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082562 Apr 12 15:05:43.012437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 553/1130] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:42 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:44.028258 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-90c2a06f-5b4f-415e-b01b-4038ccf8f7ca tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:44.028873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-90c2a06f-5b4f-415e-b01b-4038ccf8f7ca tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:44.035139 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90c2a06f-5b4f-415e-b01b-4038ccf8f7ca tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:44.035584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90c2a06f-5b4f-415e-b01b-4038ccf8f7ca tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:44.036350 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90c2a06f-5b4f-415e-b01b-4038ccf8f7ca tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:44.036780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-90c2a06f-5b4f-415e-b01b-4038ccf8f7ca tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:44.097113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-90c2a06f-5b4f-415e-b01b-4038ccf8f7ca tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:44.105205 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-90c2a06f-5b4f-415e-b01b-4038ccf8f7ca tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080561 Apr 12 15:05:44.105808 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 578/1131] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:44 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:45.122323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4e69b3a9-3c0d-4576-b0e3-e81cc4e65fb0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:45.122880 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4e69b3a9-3c0d-4576-b0e3-e81cc4e65fb0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:45.129837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e69b3a9-3c0d-4576-b0e3-e81cc4e65fb0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:45.130281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e69b3a9-3c0d-4576-b0e3-e81cc4e65fb0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:45.131040 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e69b3a9-3c0d-4576-b0e3-e81cc4e65fb0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:45.131467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e69b3a9-3c0d-4576-b0e3-e81cc4e65fb0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:45.192233 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4e69b3a9-3c0d-4576-b0e3-e81cc4e65fb0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:45.199971 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4e69b3a9-3c0d-4576-b0e3-e81cc4e65fb0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081871 Apr 12 15:05:45.200575 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 554/1132] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:45 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:46.217270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-06d630b8-c59f-4aeb-aece-4169d7d873fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:46.218379 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-06d630b8-c59f-4aeb-aece-4169d7d873fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:46.224627 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-06d630b8-c59f-4aeb-aece-4169d7d873fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:46.225064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-06d630b8-c59f-4aeb-aece-4169d7d873fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:46.225854 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-06d630b8-c59f-4aeb-aece-4169d7d873fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:46.226284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-06d630b8-c59f-4aeb-aece-4169d7d873fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:46.284977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-06d630b8-c59f-4aeb-aece-4169d7d873fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:46.292270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-06d630b8-c59f-4aeb-aece-4169d7d873fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078875 Apr 12 15:05:46.292861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 579/1133] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:46 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:47.312497 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b1df6635-4582-43ba-b84e-e5be591ed03f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:47.314298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b1df6635-4582-43ba-b84e-e5be591ed03f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:47.321275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1df6635-4582-43ba-b84e-e5be591ed03f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:47.321771 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1df6635-4582-43ba-b84e-e5be591ed03f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:47.322555 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1df6635-4582-43ba-b84e-e5be591ed03f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:47.323022 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b1df6635-4582-43ba-b84e-e5be591ed03f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:47.387060 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b1df6635-4582-43ba-b84e-e5be591ed03f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:47.394643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b1df6635-4582-43ba-b84e-e5be591ed03f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.088393 Apr 12 15:05:47.395202 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 555/1134] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:47 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:48.411820 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dac2e947-7042-4c7e-9c7e-f29af3011f43 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:48.412425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dac2e947-7042-4c7e-9c7e-f29af3011f43 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:48.418689 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dac2e947-7042-4c7e-9c7e-f29af3011f43 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:48.419131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dac2e947-7042-4c7e-9c7e-f29af3011f43 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:48.419887 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dac2e947-7042-4c7e-9c7e-f29af3011f43 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:48.420314 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dac2e947-7042-4c7e-9c7e-f29af3011f43 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:48.480499 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dac2e947-7042-4c7e-9c7e-f29af3011f43 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:48.488347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dac2e947-7042-4c7e-9c7e-f29af3011f43 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080504 Apr 12 15:05:48.488901 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 580/1135] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:48 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:49.505817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-52d6e71a-2515-44d6-a557-8e02045d41c2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:49.506419 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-52d6e71a-2515-44d6-a557-8e02045d41c2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:49.512840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-52d6e71a-2515-44d6-a557-8e02045d41c2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:49.513280 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-52d6e71a-2515-44d6-a557-8e02045d41c2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:49.514064 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-52d6e71a-2515-44d6-a557-8e02045d41c2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:49.514493 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-52d6e71a-2515-44d6-a557-8e02045d41c2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:49.574905 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-52d6e71a-2515-44d6-a557-8e02045d41c2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:49.582929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-52d6e71a-2515-44d6-a557-8e02045d41c2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081109 Apr 12 15:05:49.583507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 556/1136] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:49 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:50.600143 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b2932365-eb9d-4316-a1bb-bd6968b95f8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:50.600744 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b2932365-eb9d-4316-a1bb-bd6968b95f8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:50.607110 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b2932365-eb9d-4316-a1bb-bd6968b95f8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:50.607629 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b2932365-eb9d-4316-a1bb-bd6968b95f8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:50.608385 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b2932365-eb9d-4316-a1bb-bd6968b95f8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:50.608833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b2932365-eb9d-4316-a1bb-bd6968b95f8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:50.672728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b2932365-eb9d-4316-a1bb-bd6968b95f8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:50.680259 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b2932365-eb9d-4316-a1bb-bd6968b95f8f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083989 Apr 12 15:05:50.680848 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 581/1137] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:50 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:51.700626 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e871eae9-ac79-4788-9289-83dd7aac4b5a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:51.701472 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e871eae9-ac79-4788-9289-83dd7aac4b5a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:51.711600 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e871eae9-ac79-4788-9289-83dd7aac4b5a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:51.712269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e871eae9-ac79-4788-9289-83dd7aac4b5a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:51.713449 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e871eae9-ac79-4788-9289-83dd7aac4b5a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:51.714136 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e871eae9-ac79-4788-9289-83dd7aac4b5a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:51.787890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e871eae9-ac79-4788-9289-83dd7aac4b5a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:51.795129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e871eae9-ac79-4788-9289-83dd7aac4b5a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.100966 Apr 12 15:05:51.795695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 557/1138] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:51 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:52.812220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1377a8c4-2280-465b-a878-c1751fceadbf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:52.812826 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1377a8c4-2280-465b-a878-c1751fceadbf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:52.819338 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1377a8c4-2280-465b-a878-c1751fceadbf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:52.819780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1377a8c4-2280-465b-a878-c1751fceadbf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:52.820542 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1377a8c4-2280-465b-a878-c1751fceadbf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:52.820972 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1377a8c4-2280-465b-a878-c1751fceadbf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:52.880801 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1377a8c4-2280-465b-a878-c1751fceadbf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:52.888057 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1377a8c4-2280-465b-a878-c1751fceadbf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079950 Apr 12 15:05:52.888620 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 582/1139] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:52 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:53.905467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fd133172-6f1d-4c01-a65a-e039a80f5efc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:53.906094 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fd133172-6f1d-4c01-a65a-e039a80f5efc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:53.912465 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fd133172-6f1d-4c01-a65a-e039a80f5efc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:53.912910 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fd133172-6f1d-4c01-a65a-e039a80f5efc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:53.913694 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fd133172-6f1d-4c01-a65a-e039a80f5efc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:53.914133 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fd133172-6f1d-4c01-a65a-e039a80f5efc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:53.975721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fd133172-6f1d-4c01-a65a-e039a80f5efc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:53.983204 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fd133172-6f1d-4c01-a65a-e039a80f5efc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081647 Apr 12 15:05:53.983771 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 558/1140] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:53 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:55.000816 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1eba853e-1bcf-452d-be01-1a9ae0d17bba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:55.001403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1eba853e-1bcf-452d-be01-1a9ae0d17bba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:55.008223 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1eba853e-1bcf-452d-be01-1a9ae0d17bba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:55.009783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1eba853e-1bcf-452d-be01-1a9ae0d17bba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:55.009783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1eba853e-1bcf-452d-be01-1a9ae0d17bba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:55.009783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1eba853e-1bcf-452d-be01-1a9ae0d17bba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:55.068291 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1eba853e-1bcf-452d-be01-1a9ae0d17bba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:55.075609 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1eba853e-1bcf-452d-be01-1a9ae0d17bba tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078672 Apr 12 15:05:55.076185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 583/1141] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:54 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:56.092240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-95bd46a8-dc0f-4c51-bb40-56782bcceb83 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:56.092835 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-95bd46a8-dc0f-4c51-bb40-56782bcceb83 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:56.099777 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95bd46a8-dc0f-4c51-bb40-56782bcceb83 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:56.100222 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95bd46a8-dc0f-4c51-bb40-56782bcceb83 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:56.101030 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95bd46a8-dc0f-4c51-bb40-56782bcceb83 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:56.101457 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95bd46a8-dc0f-4c51-bb40-56782bcceb83 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:56.162933 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-95bd46a8-dc0f-4c51-bb40-56782bcceb83 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:56.170300 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-95bd46a8-dc0f-4c51-bb40-56782bcceb83 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081903 Apr 12 15:05:56.170861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 559/1142] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:56 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:57.159358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:05:57.160291 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:05:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:05:57.188301 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e8da0722-3482-4216-a9e8-5db694071a2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:57.188905 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e8da0722-3482-4216-a9e8-5db694071a2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:57.195630 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e8da0722-3482-4216-a9e8-5db694071a2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:57.196072 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e8da0722-3482-4216-a9e8-5db694071a2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:57.196832 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e8da0722-3482-4216-a9e8-5db694071a2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:57.197264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e8da0722-3482-4216-a9e8-5db694071a2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:57.255703 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e8da0722-3482-4216-a9e8-5db694071a2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:57.263113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e8da0722-3482-4216-a9e8-5db694071a2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078921 Apr 12 15:05:57.263676 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 584/1143] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:57 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:58.281907 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d3682edd-e19b-4753-b030-580e8acedf37 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:58.282595 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d3682edd-e19b-4753-b030-580e8acedf37 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:58.290104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d3682edd-e19b-4753-b030-580e8acedf37 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:58.290545 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d3682edd-e19b-4753-b030-580e8acedf37 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:58.291387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d3682edd-e19b-4753-b030-580e8acedf37 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:58.291864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d3682edd-e19b-4753-b030-580e8acedf37 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:58.354857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d3682edd-e19b-4753-b030-580e8acedf37 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:58.363241 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d3682edd-e19b-4753-b030-580e8acedf37 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085582 Apr 12 15:05:58.363241 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 560/1144] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:58 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:05:59.379641 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9ef0f953-5a64-4634-a4f7-3531d6571c75 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:05:59.380371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9ef0f953-5a64-4634-a4f7-3531d6571c75 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:05:59.386723 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ef0f953-5a64-4634-a4f7-3531d6571c75 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:59.387176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ef0f953-5a64-4634-a4f7-3531d6571c75 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:59.387951 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ef0f953-5a64-4634-a4f7-3531d6571c75 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:05:59.388382 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ef0f953-5a64-4634-a4f7-3531d6571c75 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:05:59.450064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ef0f953-5a64-4634-a4f7-3531d6571c75 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:05:59.458369 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9ef0f953-5a64-4634-a4f7-3531d6571c75 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083242 Apr 12 15:05:59.458906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 585/1145] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:05:59 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:00.476721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-23cdd66a-1609-4c98-853d-24f977cb210f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:00.477192 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-23cdd66a-1609-4c98-853d-24f977cb210f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:00.483811 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-23cdd66a-1609-4c98-853d-24f977cb210f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:00.484258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-23cdd66a-1609-4c98-853d-24f977cb210f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:00.485033 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-23cdd66a-1609-4c98-853d-24f977cb210f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:00.485461 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-23cdd66a-1609-4c98-853d-24f977cb210f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:00.551616 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-23cdd66a-1609-4c98-853d-24f977cb210f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:00.559026 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-23cdd66a-1609-4c98-853d-24f977cb210f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086462 Apr 12 15:06:00.559599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 561/1146] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:00 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:01.578071 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a6e86579-48ea-4aa2-8b46-954441517393 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:01.578717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a6e86579-48ea-4aa2-8b46-954441517393 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:01.586159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a6e86579-48ea-4aa2-8b46-954441517393 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:01.586599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a6e86579-48ea-4aa2-8b46-954441517393 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:01.587359 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a6e86579-48ea-4aa2-8b46-954441517393 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:01.587783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a6e86579-48ea-4aa2-8b46-954441517393 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:01.647381 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a6e86579-48ea-4aa2-8b46-954441517393 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:01.654692 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a6e86579-48ea-4aa2-8b46-954441517393 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082243 Apr 12 15:06:01.655246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 586/1147] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:01 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:02.671393 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ebeeb827-33db-4c96-bad3-c2df68adf0d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:02.671998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ebeeb827-33db-4c96-bad3-c2df68adf0d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:02.678754 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ebeeb827-33db-4c96-bad3-c2df68adf0d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:02.679129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ebeeb827-33db-4c96-bad3-c2df68adf0d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:02.679890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ebeeb827-33db-4c96-bad3-c2df68adf0d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:02.680324 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ebeeb827-33db-4c96-bad3-c2df68adf0d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:02.744278 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ebeeb827-33db-4c96-bad3-c2df68adf0d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:02.751642 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ebeeb827-33db-4c96-bad3-c2df68adf0d5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084019 Apr 12 15:06:02.752336 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 562/1148] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:02 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:06:03.768300 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a4cef692-e1c3-46a9-9303-d1c0f87c99df tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:03.769383 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a4cef692-e1c3-46a9-9303-d1c0f87c99df tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:03.776233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4cef692-e1c3-46a9-9303-d1c0f87c99df tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:03.776674 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4cef692-e1c3-46a9-9303-d1c0f87c99df tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:03.777428 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4cef692-e1c3-46a9-9303-d1c0f87c99df tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:03.777880 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a4cef692-e1c3-46a9-9303-d1c0f87c99df tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:03.837012 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a4cef692-e1c3-46a9-9303-d1c0f87c99df tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:03.844375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a4cef692-e1c3-46a9-9303-d1c0f87c99df tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079932 Apr 12 15:06:03.844924 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 587/1149] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:03 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:04.861712 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a2159e91-1d94-4811-94e7-6248cbce6c2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:04.862244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a2159e91-1d94-4811-94e7-6248cbce6c2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:04.868600 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a2159e91-1d94-4811-94e7-6248cbce6c2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:04.869045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a2159e91-1d94-4811-94e7-6248cbce6c2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:04.869854 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a2159e91-1d94-4811-94e7-6248cbce6c2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:04.870290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a2159e91-1d94-4811-94e7-6248cbce6c2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:04.930300 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a2159e91-1d94-4811-94e7-6248cbce6c2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:04.937970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a2159e91-1d94-4811-94e7-6248cbce6c2f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080157 Apr 12 15:06:04.938533 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 563/1150] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:04 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:06:05.955370 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0b2a10e4-85e0-47e5-99fa-9ac1dc524bad tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:05.955931 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0b2a10e4-85e0-47e5-99fa-9ac1dc524bad tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:05.963086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0b2a10e4-85e0-47e5-99fa-9ac1dc524bad tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:05.963529 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0b2a10e4-85e0-47e5-99fa-9ac1dc524bad tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:05.964453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0b2a10e4-85e0-47e5-99fa-9ac1dc524bad tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:05.964888 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0b2a10e4-85e0-47e5-99fa-9ac1dc524bad tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:06.028801 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0b2a10e4-85e0-47e5-99fa-9ac1dc524bad tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:06.043474 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0b2a10e4-85e0-47e5-99fa-9ac1dc524bad tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.091467 Apr 12 15:06:06.044521 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 588/1151] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:05 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:07.062077 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-efd3c06e-15ee-43f0-9454-ab1cded0f3a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:07.062636 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-efd3c06e-15ee-43f0-9454-ab1cded0f3a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:07.068812 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efd3c06e-15ee-43f0-9454-ab1cded0f3a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:07.076042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efd3c06e-15ee-43f0-9454-ab1cded0f3a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:07.076042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efd3c06e-15ee-43f0-9454-ab1cded0f3a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:07.076042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efd3c06e-15ee-43f0-9454-ab1cded0f3a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:07.128736 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-efd3c06e-15ee-43f0-9454-ab1cded0f3a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:07.136401 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-efd3c06e-15ee-43f0-9454-ab1cded0f3a3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078555 Apr 12 15:06:07.138876 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 564/1152] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:07 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:08.154132 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-de007c3d-c2a1-45cb-9168-c10dfe3bb16e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:08.154664 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-de007c3d-c2a1-45cb-9168-c10dfe3bb16e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:08.161380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-de007c3d-c2a1-45cb-9168-c10dfe3bb16e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:08.161853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-de007c3d-c2a1-45cb-9168-c10dfe3bb16e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:08.162617 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-de007c3d-c2a1-45cb-9168-c10dfe3bb16e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:08.163042 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-de007c3d-c2a1-45cb-9168-c10dfe3bb16e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:08.222407 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-de007c3d-c2a1-45cb-9168-c10dfe3bb16e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:08.231064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-de007c3d-c2a1-45cb-9168-c10dfe3bb16e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080883 Apr 12 15:06:08.231798 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 589/1153] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:08 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:09.251487 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b05a669a-52bf-46dd-b858-c4569b263cf4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:09.252206 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b05a669a-52bf-46dd-b858-c4569b263cf4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:09.259834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b05a669a-52bf-46dd-b858-c4569b263cf4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:09.260286 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b05a669a-52bf-46dd-b858-c4569b263cf4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:09.261072 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b05a669a-52bf-46dd-b858-c4569b263cf4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:09.261513 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b05a669a-52bf-46dd-b858-c4569b263cf4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:09.326969 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b05a669a-52bf-46dd-b858-c4569b263cf4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:09.334665 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b05a669a-52bf-46dd-b858-c4569b263cf4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.088747 Apr 12 15:06:09.335231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 565/1154] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:09 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:10.351253 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-39e4d6e3-49cc-4029-aee5-02fe111dcbed tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:10.351882 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-39e4d6e3-49cc-4029-aee5-02fe111dcbed tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:10.358163 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-39e4d6e3-49cc-4029-aee5-02fe111dcbed tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:10.358603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-39e4d6e3-49cc-4029-aee5-02fe111dcbed tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:10.359360 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-39e4d6e3-49cc-4029-aee5-02fe111dcbed tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:10.359783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-39e4d6e3-49cc-4029-aee5-02fe111dcbed tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:10.419431 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-39e4d6e3-49cc-4029-aee5-02fe111dcbed tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:10.427500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-39e4d6e3-49cc-4029-aee5-02fe111dcbed tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080707 Apr 12 15:06:10.428072 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 590/1155] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:10 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:11.444526 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dfe104e7-1042-40be-907d-769ea9d20021 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:11.445159 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dfe104e7-1042-40be-907d-769ea9d20021 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:11.451439 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfe104e7-1042-40be-907d-769ea9d20021 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:11.451887 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfe104e7-1042-40be-907d-769ea9d20021 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:11.452648 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfe104e7-1042-40be-907d-769ea9d20021 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:11.453080 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dfe104e7-1042-40be-907d-769ea9d20021 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:11.512926 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dfe104e7-1042-40be-907d-769ea9d20021 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:11.520997 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dfe104e7-1042-40be-907d-769ea9d20021 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080095 Apr 12 15:06:11.521650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 566/1156] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:11 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:12.538691 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f0744b22-0292-4374-ad33-2b48f58f7abf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:12.539639 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f0744b22-0292-4374-ad33-2b48f58f7abf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:12.546670 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f0744b22-0292-4374-ad33-2b48f58f7abf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:12.547117 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f0744b22-0292-4374-ad33-2b48f58f7abf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:12.547888 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f0744b22-0292-4374-ad33-2b48f58f7abf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:12.548316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f0744b22-0292-4374-ad33-2b48f58f7abf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:12.615842 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f0744b22-0292-4374-ad33-2b48f58f7abf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:12.623503 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f0744b22-0292-4374-ad33-2b48f58f7abf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.089268 Apr 12 15:06:12.624071 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 591/1157] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:12 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:06:13.641178 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-75029da8-6932-4cea-965d-0ffb1f30236e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:13.647878 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-75029da8-6932-4cea-965d-0ffb1f30236e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:13.648300 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75029da8-6932-4cea-965d-0ffb1f30236e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:13.648741 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75029da8-6932-4cea-965d-0ffb1f30236e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:13.649498 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75029da8-6932-4cea-965d-0ffb1f30236e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:13.649952 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75029da8-6932-4cea-965d-0ffb1f30236e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:13.712240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-75029da8-6932-4cea-965d-0ffb1f30236e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:13.719569 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-75029da8-6932-4cea-965d-0ffb1f30236e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082721 Apr 12 15:06:13.720128 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 567/1158] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:13 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:14.736374 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-07740cd5-cea5-4a20-8989-e4b8c7a425ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:14.736983 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-07740cd5-cea5-4a20-8989-e4b8c7a425ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:14.743852 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-07740cd5-cea5-4a20-8989-e4b8c7a425ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:14.744297 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-07740cd5-cea5-4a20-8989-e4b8c7a425ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:14.745059 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-07740cd5-cea5-4a20-8989-e4b8c7a425ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:14.745521 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-07740cd5-cea5-4a20-8989-e4b8c7a425ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:14.803912 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-07740cd5-cea5-4a20-8989-e4b8c7a425ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:14.811517 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-07740cd5-cea5-4a20-8989-e4b8c7a425ac tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079064 Apr 12 15:06:14.812078 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 592/1159] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:14 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:15.828379 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3cacc438-30df-4bfc-a70d-17dfb469812c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:15.828937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3cacc438-30df-4bfc-a70d-17dfb469812c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:15.836059 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cacc438-30df-4bfc-a70d-17dfb469812c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:15.836503 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cacc438-30df-4bfc-a70d-17dfb469812c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:15.837269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cacc438-30df-4bfc-a70d-17dfb469812c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:15.837730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3cacc438-30df-4bfc-a70d-17dfb469812c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:15.899484 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3cacc438-30df-4bfc-a70d-17dfb469812c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:15.906789 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3cacc438-30df-4bfc-a70d-17dfb469812c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082412 Apr 12 15:06:15.907528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 568/1160] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:15 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:16.926956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1d8a9f92-3719-4166-8aa5-e6e5bc1ef995 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:16.927502 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1d8a9f92-3719-4166-8aa5-e6e5bc1ef995 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:16.933458 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d8a9f92-3719-4166-8aa5-e6e5bc1ef995 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:16.933941 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d8a9f92-3719-4166-8aa5-e6e5bc1ef995 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:16.934976 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d8a9f92-3719-4166-8aa5-e6e5bc1ef995 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:16.935408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1d8a9f92-3719-4166-8aa5-e6e5bc1ef995 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:16.995199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1d8a9f92-3719-4166-8aa5-e6e5bc1ef995 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:17.002404 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1d8a9f92-3719-4166-8aa5-e6e5bc1ef995 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081454 Apr 12 15:06:17.002961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 593/1161] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:16 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:18.019303 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6efb149b-374e-446e-b667-18c988074d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:18.020519 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6efb149b-374e-446e-b667-18c988074d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:18.027933 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6efb149b-374e-446e-b667-18c988074d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:18.028461 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6efb149b-374e-446e-b667-18c988074d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:18.029502 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6efb149b-374e-446e-b667-18c988074d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:18.029951 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6efb149b-374e-446e-b667-18c988074d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:18.092140 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6efb149b-374e-446e-b667-18c988074d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:18.100268 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6efb149b-374e-446e-b667-18c988074d87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084945 Apr 12 15:06:18.100840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 569/1162] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:18 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:19.117279 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e118073d-c7ad-485c-8b6b-d01240196337 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:19.117912 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e118073d-c7ad-485c-8b6b-d01240196337 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:19.124122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e118073d-c7ad-485c-8b6b-d01240196337 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:19.124563 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e118073d-c7ad-485c-8b6b-d01240196337 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:19.125313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e118073d-c7ad-485c-8b6b-d01240196337 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:19.125774 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e118073d-c7ad-485c-8b6b-d01240196337 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:19.185360 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e118073d-c7ad-485c-8b6b-d01240196337 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:19.193082 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e118073d-c7ad-485c-8b6b-d01240196337 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080697 Apr 12 15:06:19.193671 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 594/1163] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:19 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:19.717787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:06:19.717959 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:06:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:06:20.211571 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c9caa416-8fcc-4de4-abbb-5ceac54447e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:20.212176 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c9caa416-8fcc-4de4-abbb-5ceac54447e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:20.218483 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9caa416-8fcc-4de4-abbb-5ceac54447e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:20.218924 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9caa416-8fcc-4de4-abbb-5ceac54447e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:20.219683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9caa416-8fcc-4de4-abbb-5ceac54447e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:20.220106 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9caa416-8fcc-4de4-abbb-5ceac54447e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:20.279655 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c9caa416-8fcc-4de4-abbb-5ceac54447e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:20.287630 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c9caa416-8fcc-4de4-abbb-5ceac54447e4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081300 Apr 12 15:06:20.288193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 570/1164] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:20 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:21.305172 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-201df9b7-bc13-4461-a52d-8f5ea7296354 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:21.305739 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-201df9b7-bc13-4461-a52d-8f5ea7296354 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:21.311876 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-201df9b7-bc13-4461-a52d-8f5ea7296354 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:21.312312 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-201df9b7-bc13-4461-a52d-8f5ea7296354 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:21.313068 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-201df9b7-bc13-4461-a52d-8f5ea7296354 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:21.313483 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-201df9b7-bc13-4461-a52d-8f5ea7296354 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:21.376321 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-201df9b7-bc13-4461-a52d-8f5ea7296354 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:21.384325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-201df9b7-bc13-4461-a52d-8f5ea7296354 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083817 Apr 12 15:06:21.384890 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 595/1165] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:21 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:22.401943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f6d1e0ba-e09a-4ef7-94cf-2c8266cc4169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:22.402481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f6d1e0ba-e09a-4ef7-94cf-2c8266cc4169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:22.408983 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f6d1e0ba-e09a-4ef7-94cf-2c8266cc4169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:22.409452 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f6d1e0ba-e09a-4ef7-94cf-2c8266cc4169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:22.410288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f6d1e0ba-e09a-4ef7-94cf-2c8266cc4169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:22.410725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f6d1e0ba-e09a-4ef7-94cf-2c8266cc4169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:22.472965 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f6d1e0ba-e09a-4ef7-94cf-2c8266cc4169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:22.480745 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f6d1e0ba-e09a-4ef7-94cf-2c8266cc4169 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082802 Apr 12 15:06:22.481329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 571/1166] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:22 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:23.497757 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1c695a9d-1f2b-4064-8929-bdcd649a97f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:23.498403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1c695a9d-1f2b-4064-8929-bdcd649a97f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:23.505034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c695a9d-1f2b-4064-8929-bdcd649a97f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:23.505469 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c695a9d-1f2b-4064-8929-bdcd649a97f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:23.506826 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c695a9d-1f2b-4064-8929-bdcd649a97f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:23.506964 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c695a9d-1f2b-4064-8929-bdcd649a97f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:23.806053 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1c695a9d-1f2b-4064-8929-bdcd649a97f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:23.813714 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1c695a9d-1f2b-4064-8929-bdcd649a97f1 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.319994 Apr 12 15:06:23.814269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 596/1167] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:23 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:24.831211 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fbbf686e-afef-4cba-88c8-0b3da2fb3107 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:24.831742 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fbbf686e-afef-4cba-88c8-0b3da2fb3107 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:24.838929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fbbf686e-afef-4cba-88c8-0b3da2fb3107 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:24.839383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fbbf686e-afef-4cba-88c8-0b3da2fb3107 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:24.840142 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fbbf686e-afef-4cba-88c8-0b3da2fb3107 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:24.840570 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fbbf686e-afef-4cba-88c8-0b3da2fb3107 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:24.898678 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fbbf686e-afef-4cba-88c8-0b3da2fb3107 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:24.906013 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fbbf686e-afef-4cba-88c8-0b3da2fb3107 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078727 Apr 12 15:06:24.906579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 572/1168] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:24 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:25.923434 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-208c7f24-1d19-47b4-b1a4-b489702b95b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:25.924227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-208c7f24-1d19-47b4-b1a4-b489702b95b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:25.931300 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-208c7f24-1d19-47b4-b1a4-b489702b95b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:25.931735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-208c7f24-1d19-47b4-b1a4-b489702b95b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:25.932640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-208c7f24-1d19-47b4-b1a4-b489702b95b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:25.933079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-208c7f24-1d19-47b4-b1a4-b489702b95b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:25.994609 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-208c7f24-1d19-47b4-b1a4-b489702b95b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:26.002053 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-208c7f24-1d19-47b4-b1a4-b489702b95b8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082587 Apr 12 15:06:26.002608 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 597/1169] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:25 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:27.019366 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1406aeab-603a-4f62-80af-ea6e654edc29 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:27.020574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1406aeab-603a-4f62-80af-ea6e654edc29 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:27.027030 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1406aeab-603a-4f62-80af-ea6e654edc29 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:27.027467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1406aeab-603a-4f62-80af-ea6e654edc29 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:27.028237 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1406aeab-603a-4f62-80af-ea6e654edc29 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:27.028673 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1406aeab-603a-4f62-80af-ea6e654edc29 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:27.087671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1406aeab-603a-4f62-80af-ea6e654edc29 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:27.095031 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1406aeab-603a-4f62-80af-ea6e654edc29 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079479 Apr 12 15:06:27.095546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 573/1170] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:27 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:28.112700 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d137a149-aae4-4bf4-a4a3-b6c6ea67bd7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:28.113304 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d137a149-aae4-4bf4-a4a3-b6c6ea67bd7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:28.120102 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d137a149-aae4-4bf4-a4a3-b6c6ea67bd7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:28.120552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d137a149-aae4-4bf4-a4a3-b6c6ea67bd7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:28.121330 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d137a149-aae4-4bf4-a4a3-b6c6ea67bd7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:28.121801 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d137a149-aae4-4bf4-a4a3-b6c6ea67bd7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:28.186012 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d137a149-aae4-4bf4-a4a3-b6c6ea67bd7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:28.193960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d137a149-aae4-4bf4-a4a3-b6c6ea67bd7d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085076 Apr 12 15:06:28.194537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 598/1171] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:28 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:29.210681 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7853954b-96a2-4a9e-8937-d7a40353618b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:29.211292 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7853954b-96a2-4a9e-8937-d7a40353618b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:29.217460 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7853954b-96a2-4a9e-8937-d7a40353618b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:29.217944 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7853954b-96a2-4a9e-8937-d7a40353618b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:29.218710 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7853954b-96a2-4a9e-8937-d7a40353618b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:29.219145 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7853954b-96a2-4a9e-8937-d7a40353618b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:29.277954 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7853954b-96a2-4a9e-8937-d7a40353618b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:29.285311 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7853954b-96a2-4a9e-8937-d7a40353618b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078578 Apr 12 15:06:29.285908 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 574/1172] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:29 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:30.303541 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-aa9d7bbe-b15c-48a8-8df2-6f857001ff6f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:30.304150 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-aa9d7bbe-b15c-48a8-8df2-6f857001ff6f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:30.310749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aa9d7bbe-b15c-48a8-8df2-6f857001ff6f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:30.311200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aa9d7bbe-b15c-48a8-8df2-6f857001ff6f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:30.311957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aa9d7bbe-b15c-48a8-8df2-6f857001ff6f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:30.312387 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-aa9d7bbe-b15c-48a8-8df2-6f857001ff6f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:30.380550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-aa9d7bbe-b15c-48a8-8df2-6f857001ff6f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:30.388196 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-aa9d7bbe-b15c-48a8-8df2-6f857001ff6f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.089241 Apr 12 15:06:30.388750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 599/1173] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:30 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:31.405513 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-78bb3847-4ed7-4be4-a3f2-3965319a1edb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:31.406161 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-78bb3847-4ed7-4be4-a3f2-3965319a1edb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:31.412578 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-78bb3847-4ed7-4be4-a3f2-3965319a1edb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:31.413030 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-78bb3847-4ed7-4be4-a3f2-3965319a1edb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:31.413840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-78bb3847-4ed7-4be4-a3f2-3965319a1edb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:31.414276 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-78bb3847-4ed7-4be4-a3f2-3965319a1edb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:31.482375 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-78bb3847-4ed7-4be4-a3f2-3965319a1edb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:31.490418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-78bb3847-4ed7-4be4-a3f2-3965319a1edb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.087964 Apr 12 15:06:31.491308 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 575/1174] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:31 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:32.508180 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-87e775c7-d830-49a0-a6b8-f4b91a418090 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:32.508829 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-87e775c7-d830-49a0-a6b8-f4b91a418090 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:32.515071 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87e775c7-d830-49a0-a6b8-f4b91a418090 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:32.515512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87e775c7-d830-49a0-a6b8-f4b91a418090 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:32.516274 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87e775c7-d830-49a0-a6b8-f4b91a418090 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:32.516704 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-87e775c7-d830-49a0-a6b8-f4b91a418090 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:32.578381 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-87e775c7-d830-49a0-a6b8-f4b91a418090 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:32.585801 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-87e775c7-d830-49a0-a6b8-f4b91a418090 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082171 Apr 12 15:06:32.586360 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 600/1175] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:32 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:33.602871 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6850a605-4b16-441d-adf6-bea305e5640e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:33.603475 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6850a605-4b16-441d-adf6-bea305e5640e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:33.609734 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6850a605-4b16-441d-adf6-bea305e5640e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:33.610175 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6850a605-4b16-441d-adf6-bea305e5640e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:33.610955 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6850a605-4b16-441d-adf6-bea305e5640e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:33.611378 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6850a605-4b16-441d-adf6-bea305e5640e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:33.671286 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6850a605-4b16-441d-adf6-bea305e5640e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:33.679146 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6850a605-4b16-441d-adf6-bea305e5640e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080737 Apr 12 15:06:33.679714 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 576/1176] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:33 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:34.696264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e0679585-d0cc-4677-a2bb-4e0bff3682b2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:34.696788 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e0679585-d0cc-4677-a2bb-4e0bff3682b2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:34.703087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e0679585-d0cc-4677-a2bb-4e0bff3682b2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:34.703533 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e0679585-d0cc-4677-a2bb-4e0bff3682b2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:34.704293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e0679585-d0cc-4677-a2bb-4e0bff3682b2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:34.704725 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e0679585-d0cc-4677-a2bb-4e0bff3682b2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:34.763116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e0679585-d0cc-4677-a2bb-4e0bff3682b2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:34.770258 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e0679585-d0cc-4677-a2bb-4e0bff3682b2 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078165 Apr 12 15:06:34.770818 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 601/1177] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:34 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:35.787671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8703298b-0501-4a75-a1c3-aecb5151f46c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:35.788380 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8703298b-0501-4a75-a1c3-aecb5151f46c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:35.794272 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8703298b-0501-4a75-a1c3-aecb5151f46c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:35.794721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8703298b-0501-4a75-a1c3-aecb5151f46c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:35.795478 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8703298b-0501-4a75-a1c3-aecb5151f46c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:35.795909 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8703298b-0501-4a75-a1c3-aecb5151f46c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:35.854498 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8703298b-0501-4a75-a1c3-aecb5151f46c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:35.861695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8703298b-0501-4a75-a1c3-aecb5151f46c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078450 Apr 12 15:06:35.862267 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 577/1178] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:35 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:36.878915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fda65159-974e-4b8d-8ba3-5d8e630edbbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:36.879521 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fda65159-974e-4b8d-8ba3-5d8e630edbbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:36.886902 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fda65159-974e-4b8d-8ba3-5d8e630edbbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:36.887380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fda65159-974e-4b8d-8ba3-5d8e630edbbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:36.888141 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fda65159-974e-4b8d-8ba3-5d8e630edbbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:36.888564 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fda65159-974e-4b8d-8ba3-5d8e630edbbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:36.949620 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fda65159-974e-4b8d-8ba3-5d8e630edbbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:36.956822 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fda65159-974e-4b8d-8ba3-5d8e630edbbe tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081826 Apr 12 15:06:36.957377 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 602/1179] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:36 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:37.973946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d0ee55f4-5838-48c2-92a6-9896bb94b91d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:37.974669 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d0ee55f4-5838-48c2-92a6-9896bb94b91d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:37.981079 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0ee55f4-5838-48c2-92a6-9896bb94b91d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:37.981530 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0ee55f4-5838-48c2-92a6-9896bb94b91d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:37.982363 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0ee55f4-5838-48c2-92a6-9896bb94b91d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:37.982799 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d0ee55f4-5838-48c2-92a6-9896bb94b91d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:38.048615 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d0ee55f4-5838-48c2-92a6-9896bb94b91d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:38.056403 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d0ee55f4-5838-48c2-92a6-9896bb94b91d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086438 Apr 12 15:06:38.057030 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 578/1180] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:37 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:39.077575 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2ad9bc28-131f-4aff-ba06-9536fc454741 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:39.078264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2ad9bc28-131f-4aff-ba06-9536fc454741 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:39.084622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ad9bc28-131f-4aff-ba06-9536fc454741 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:39.085123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ad9bc28-131f-4aff-ba06-9536fc454741 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:39.091993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ad9bc28-131f-4aff-ba06-9536fc454741 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:39.091993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2ad9bc28-131f-4aff-ba06-9536fc454741 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:39.154446 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2ad9bc28-131f-4aff-ba06-9536fc454741 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:39.168091 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2ad9bc28-131f-4aff-ba06-9536fc454741 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.097916 Apr 12 15:06:39.168677 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 603/1181] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:39 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:40.184735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a7187f8e-4ed8-4496-bed7-dd9fc1ad71e3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:40.185346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a7187f8e-4ed8-4496-bed7-dd9fc1ad71e3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:40.191632 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a7187f8e-4ed8-4496-bed7-dd9fc1ad71e3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:40.192084 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a7187f8e-4ed8-4496-bed7-dd9fc1ad71e3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:40.192855 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a7187f8e-4ed8-4496-bed7-dd9fc1ad71e3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:40.193375 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a7187f8e-4ed8-4496-bed7-dd9fc1ad71e3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:40.251302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a7187f8e-4ed8-4496-bed7-dd9fc1ad71e3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:40.258528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a7187f8e-4ed8-4496-bed7-dd9fc1ad71e3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.077998 Apr 12 15:06:40.259094 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 579/1182] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:40 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:41.275485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-148ad863-6995-40fa-865d-2c98a0120369 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:41.276093 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-148ad863-6995-40fa-865d-2c98a0120369 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:41.282352 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-148ad863-6995-40fa-865d-2c98a0120369 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:41.282796 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-148ad863-6995-40fa-865d-2c98a0120369 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:41.283557 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-148ad863-6995-40fa-865d-2c98a0120369 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:41.283988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-148ad863-6995-40fa-865d-2c98a0120369 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:41.345428 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-148ad863-6995-40fa-865d-2c98a0120369 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:41.353432 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-148ad863-6995-40fa-865d-2c98a0120369 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082139 Apr 12 15:06:41.354019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 604/1183] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:41 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:42.369481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9e7ef697-24a6-48b2-8f23-93647ed90542 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:42.370161 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9e7ef697-24a6-48b2-8f23-93647ed90542 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:42.376465 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9e7ef697-24a6-48b2-8f23-93647ed90542 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:42.376911 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9e7ef697-24a6-48b2-8f23-93647ed90542 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:42.377697 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9e7ef697-24a6-48b2-8f23-93647ed90542 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:42.378134 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9e7ef697-24a6-48b2-8f23-93647ed90542 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:42.441193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9e7ef697-24a6-48b2-8f23-93647ed90542 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:42.449328 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9e7ef697-24a6-48b2-8f23-93647ed90542 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083745 Apr 12 15:06:42.450033 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 580/1184] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:42 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:43.465591 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-decff54a-1ad7-4e41-bd87-76aa7371ea57 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:43.466219 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-decff54a-1ad7-4e41-bd87-76aa7371ea57 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:43.472768 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-decff54a-1ad7-4e41-bd87-76aa7371ea57 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:43.473260 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-decff54a-1ad7-4e41-bd87-76aa7371ea57 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:43.474704 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-decff54a-1ad7-4e41-bd87-76aa7371ea57 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:43.475990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-decff54a-1ad7-4e41-bd87-76aa7371ea57 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:43.538695 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-decff54a-1ad7-4e41-bd87-76aa7371ea57 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:43.546198 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-decff54a-1ad7-4e41-bd87-76aa7371ea57 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084426 Apr 12 15:06:43.546764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 605/1185] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:43 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:44.572532 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bb2677fe-ace9-4948-ba91-a38159705e8b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:44.573172 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bb2677fe-ace9-4948-ba91-a38159705e8b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:44.578937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bb2677fe-ace9-4948-ba91-a38159705e8b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:44.579435 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bb2677fe-ace9-4948-ba91-a38159705e8b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:44.580268 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bb2677fe-ace9-4948-ba91-a38159705e8b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:44.580708 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bb2677fe-ace9-4948-ba91-a38159705e8b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:44.644136 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bb2677fe-ace9-4948-ba91-a38159705e8b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:44.652203 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bb2677fe-ace9-4948-ba91-a38159705e8b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084842 Apr 12 15:06:44.652772 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 581/1186] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:44 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:45.668537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d5f6587f-2c10-4c2f-8721-abb51bab8089 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:45.669180 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d5f6587f-2c10-4c2f-8721-abb51bab8089 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:45.675599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5f6587f-2c10-4c2f-8721-abb51bab8089 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:45.676695 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5f6587f-2c10-4c2f-8721-abb51bab8089 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:45.676944 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5f6587f-2c10-4c2f-8721-abb51bab8089 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:45.677212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d5f6587f-2c10-4c2f-8721-abb51bab8089 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:45.736000 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d5f6587f-2c10-4c2f-8721-abb51bab8089 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:45.743752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d5f6587f-2c10-4c2f-8721-abb51bab8089 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079114 Apr 12 15:06:45.744311 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 606/1187] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:45 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:46.760235 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a2fafe4b-742f-4dd2-b76e-375020b10737 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:46.760838 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a2fafe4b-742f-4dd2-b76e-375020b10737 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:46.767080 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a2fafe4b-742f-4dd2-b76e-375020b10737 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:46.767522 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a2fafe4b-742f-4dd2-b76e-375020b10737 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:46.768528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a2fafe4b-742f-4dd2-b76e-375020b10737 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:46.769055 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a2fafe4b-742f-4dd2-b76e-375020b10737 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:46.829901 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a2fafe4b-742f-4dd2-b76e-375020b10737 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:46.837927 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a2fafe4b-742f-4dd2-b76e-375020b10737 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081580 Apr 12 15:06:46.838490 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 582/1188] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:46 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:47.854527 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8a295abc-9fa5-4901-8771-81cf8d82a481 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:47.855068 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8a295abc-9fa5-4901-8771-81cf8d82a481 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:47.861351 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8a295abc-9fa5-4901-8771-81cf8d82a481 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:47.861850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8a295abc-9fa5-4901-8771-81cf8d82a481 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:47.862618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8a295abc-9fa5-4901-8771-81cf8d82a481 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:47.863062 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8a295abc-9fa5-4901-8771-81cf8d82a481 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:47.921562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8a295abc-9fa5-4901-8771-81cf8d82a481 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:47.929007 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8a295abc-9fa5-4901-8771-81cf8d82a481 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078384 Apr 12 15:06:47.929571 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 607/1189] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:47 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:48.946454 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5cc2169d-2978-4972-b7de-b60ba28d126b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:48.947003 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5cc2169d-2978-4972-b7de-b60ba28d126b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:48.953231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5cc2169d-2978-4972-b7de-b60ba28d126b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:48.953705 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5cc2169d-2978-4972-b7de-b60ba28d126b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:48.954461 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5cc2169d-2978-4972-b7de-b60ba28d126b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:48.954890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5cc2169d-2978-4972-b7de-b60ba28d126b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:49.014984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5cc2169d-2978-4972-b7de-b60ba28d126b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:49.022332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5cc2169d-2978-4972-b7de-b60ba28d126b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080263 Apr 12 15:06:49.022882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 583/1190] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:48 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:50.039800 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f4fd5781-8697-4ced-af83-cd3aea746937 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:50.040347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f4fd5781-8697-4ced-af83-cd3aea746937 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:50.046595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f4fd5781-8697-4ced-af83-cd3aea746937 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:50.047036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f4fd5781-8697-4ced-af83-cd3aea746937 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:50.047787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f4fd5781-8697-4ced-af83-cd3aea746937 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:50.048214 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f4fd5781-8697-4ced-af83-cd3aea746937 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:50.110364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f4fd5781-8697-4ced-af83-cd3aea746937 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:50.118975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f4fd5781-8697-4ced-af83-cd3aea746937 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083813 Apr 12 15:06:50.119562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 608/1191] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:50 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:51.136250 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7c66e71e-9f6a-441b-b48b-4e12ecba2dc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:51.136804 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7c66e71e-9f6a-441b-b48b-4e12ecba2dc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:51.143053 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7c66e71e-9f6a-441b-b48b-4e12ecba2dc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:51.143501 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7c66e71e-9f6a-441b-b48b-4e12ecba2dc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:51.144257 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7c66e71e-9f6a-441b-b48b-4e12ecba2dc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:51.144691 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7c66e71e-9f6a-441b-b48b-4e12ecba2dc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:51.205501 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7c66e71e-9f6a-441b-b48b-4e12ecba2dc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:51.212808 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7c66e71e-9f6a-441b-b48b-4e12ecba2dc3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080598 Apr 12 15:06:51.213367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 584/1192] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:51 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:52.229606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bd855cce-67f7-4471-b1d8-5a7fd423781a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:52.230207 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bd855cce-67f7-4471-b1d8-5a7fd423781a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:52.236414 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd855cce-67f7-4471-b1d8-5a7fd423781a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:52.236862 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd855cce-67f7-4471-b1d8-5a7fd423781a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:52.237621 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd855cce-67f7-4471-b1d8-5a7fd423781a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:52.238075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd855cce-67f7-4471-b1d8-5a7fd423781a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:52.295771 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bd855cce-67f7-4471-b1d8-5a7fd423781a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:52.303761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bd855cce-67f7-4471-b1d8-5a7fd423781a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.077534 Apr 12 15:06:52.304322 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 609/1193] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:52 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:53.320595 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9a0bab6e-85e2-43ad-aee6-d937b9010dfc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:53.321293 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9a0bab6e-85e2-43ad-aee6-d937b9010dfc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:53.327544 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9a0bab6e-85e2-43ad-aee6-d937b9010dfc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:53.327991 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9a0bab6e-85e2-43ad-aee6-d937b9010dfc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:53.328754 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9a0bab6e-85e2-43ad-aee6-d937b9010dfc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:53.329183 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9a0bab6e-85e2-43ad-aee6-d937b9010dfc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:53.388992 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9a0bab6e-85e2-43ad-aee6-d937b9010dfc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:53.396365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9a0bab6e-85e2-43ad-aee6-d937b9010dfc tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079819 Apr 12 15:06:53.397535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 585/1194] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:53 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:54.414331 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2c71d0d2-c7c7-4ca9-9735-522ef437f18b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:54.414945 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2c71d0d2-c7c7-4ca9-9735-522ef437f18b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:54.421206 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c71d0d2-c7c7-4ca9-9735-522ef437f18b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:54.421675 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c71d0d2-c7c7-4ca9-9735-522ef437f18b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:54.422441 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c71d0d2-c7c7-4ca9-9735-522ef437f18b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:54.422873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2c71d0d2-c7c7-4ca9-9735-522ef437f18b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:54.484594 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2c71d0d2-c7c7-4ca9-9735-522ef437f18b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:54.492472 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2c71d0d2-c7c7-4ca9-9735-522ef437f18b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082604 Apr 12 15:06:54.493031 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 610/1195] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:54 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:55.509520 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b944eea2-f273-47a3-8de2-c47f89530497 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:55.510620 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b944eea2-f273-47a3-8de2-c47f89530497 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:55.518586 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b944eea2-f273-47a3-8de2-c47f89530497 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:55.519034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b944eea2-f273-47a3-8de2-c47f89530497 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:55.519797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b944eea2-f273-47a3-8de2-c47f89530497 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:55.520232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b944eea2-f273-47a3-8de2-c47f89530497 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:55.586691 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b944eea2-f273-47a3-8de2-c47f89530497 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:55.594095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b944eea2-f273-47a3-8de2-c47f89530497 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.088702 Apr 12 15:06:55.594666 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 586/1196] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:55 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:56.611721 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-397bb719-5d70-44fa-b855-9148efce1ea9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:56.612329 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-397bb719-5d70-44fa-b855-9148efce1ea9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:56.619286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-397bb719-5d70-44fa-b855-9148efce1ea9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:56.619739 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-397bb719-5d70-44fa-b855-9148efce1ea9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:56.620503 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-397bb719-5d70-44fa-b855-9148efce1ea9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:56.620938 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-397bb719-5d70-44fa-b855-9148efce1ea9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:56.680223 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-397bb719-5d70-44fa-b855-9148efce1ea9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:56.687894 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-397bb719-5d70-44fa-b855-9148efce1ea9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080081 Apr 12 15:06:56.688478 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 611/1197] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:56 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:57.705618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dd465e91-656b-4f6f-b407-5e6a64efff51 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:57.706178 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dd465e91-656b-4f6f-b407-5e6a64efff51 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:57.713788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd465e91-656b-4f6f-b407-5e6a64efff51 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:57.714238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd465e91-656b-4f6f-b407-5e6a64efff51 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:57.715000 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd465e91-656b-4f6f-b407-5e6a64efff51 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:57.715429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd465e91-656b-4f6f-b407-5e6a64efff51 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:57.776750 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd465e91-656b-4f6f-b407-5e6a64efff51 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:57.784421 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dd465e91-656b-4f6f-b407-5e6a64efff51 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082673 Apr 12 15:06:57.784987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 587/1198] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:57 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:58.803529 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b4743f81-0319-4de5-a705-ba8411098e66 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:58.804982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b4743f81-0319-4de5-a705-ba8411098e66 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:58.813141 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4743f81-0319-4de5-a705-ba8411098e66 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:58.813588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4743f81-0319-4de5-a705-ba8411098e66 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:58.814518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4743f81-0319-4de5-a705-ba8411098e66 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:58.815040 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4743f81-0319-4de5-a705-ba8411098e66 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:58.881787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b4743f81-0319-4de5-a705-ba8411098e66 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:06:58.889787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b4743f81-0319-4de5-a705-ba8411098e66 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.091174 Apr 12 15:06:58.890354 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 612/1199] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:58 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:06:59.910633 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c1ba8d4b-6670-418b-9ecf-20f039853838 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:06:59.911608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c1ba8d4b-6670-418b-9ecf-20f039853838 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:06:59.918732 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1ba8d4b-6670-418b-9ecf-20f039853838 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:59.919176 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1ba8d4b-6670-418b-9ecf-20f039853838 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:06:59.919957 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1ba8d4b-6670-418b-9ecf-20f039853838 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:06:59.920387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1ba8d4b-6670-418b-9ecf-20f039853838 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:00.004169 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c1ba8d4b-6670-418b-9ecf-20f039853838 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:00.013109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c1ba8d4b-6670-418b-9ecf-20f039853838 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.109247 Apr 12 15:07:00.013712 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 588/1200] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:06:59 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:01.032123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-da76cf88-1a7b-49a9-80b5-bd4d2962a9d9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:01.032730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-da76cf88-1a7b-49a9-80b5-bd4d2962a9d9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:01.039653 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da76cf88-1a7b-49a9-80b5-bd4d2962a9d9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:01.040102 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da76cf88-1a7b-49a9-80b5-bd4d2962a9d9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:01.040985 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da76cf88-1a7b-49a9-80b5-bd4d2962a9d9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:01.041424 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da76cf88-1a7b-49a9-80b5-bd4d2962a9d9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:01.100569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-da76cf88-1a7b-49a9-80b5-bd4d2962a9d9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:01.108300 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-da76cf88-1a7b-49a9-80b5-bd4d2962a9d9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079987 Apr 12 15:07:01.108873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 613/1201] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:01 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:02.124702 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-40fb8357-05e5-4007-84a4-9ca9f92af3e9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:02.125307 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-40fb8357-05e5-4007-84a4-9ca9f92af3e9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:02.131641 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-40fb8357-05e5-4007-84a4-9ca9f92af3e9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:02.132196 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-40fb8357-05e5-4007-84a4-9ca9f92af3e9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:02.132967 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-40fb8357-05e5-4007-84a4-9ca9f92af3e9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:02.133394 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-40fb8357-05e5-4007-84a4-9ca9f92af3e9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:02.191658 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-40fb8357-05e5-4007-84a4-9ca9f92af3e9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:02.199346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-40fb8357-05e5-4007-84a4-9ca9f92af3e9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.078503 Apr 12 15:07:02.199913 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 589/1202] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:02 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:03.217215 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f87ff9b9-4e9c-4beb-95f7-7a0ddec84069 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:03.217887 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f87ff9b9-4e9c-4beb-95f7-7a0ddec84069 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:03.224335 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f87ff9b9-4e9c-4beb-95f7-7a0ddec84069 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:03.224945 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f87ff9b9-4e9c-4beb-95f7-7a0ddec84069 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:03.226207 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f87ff9b9-4e9c-4beb-95f7-7a0ddec84069 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:03.226754 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f87ff9b9-4e9c-4beb-95f7-7a0ddec84069 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:03.289354 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f87ff9b9-4e9c-4beb-95f7-7a0ddec84069 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:03.298400 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f87ff9b9-4e9c-4beb-95f7-7a0ddec84069 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085235 Apr 12 15:07:03.299185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 614/1203] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:03 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:04.316429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-35fb6498-aa0d-4763-ad0e-6c602bba068d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:04.316973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-35fb6498-aa0d-4763-ad0e-6c602bba068d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:04.323363 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35fb6498-aa0d-4763-ad0e-6c602bba068d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:04.323808 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35fb6498-aa0d-4763-ad0e-6c602bba068d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:04.324568 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35fb6498-aa0d-4763-ad0e-6c602bba068d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:04.324997 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35fb6498-aa0d-4763-ad0e-6c602bba068d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:04.384189 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-35fb6498-aa0d-4763-ad0e-6c602bba068d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:04.392009 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-35fb6498-aa0d-4763-ad0e-6c602bba068d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079428 Apr 12 15:07:04.392691 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 590/1204] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:04 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:05.411454 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-566c7d48-6371-49ea-b564-1d1525a31910 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:05.412015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-566c7d48-6371-49ea-b564-1d1525a31910 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:05.418387 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-566c7d48-6371-49ea-b564-1d1525a31910 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:05.418835 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-566c7d48-6371-49ea-b564-1d1525a31910 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:05.419595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-566c7d48-6371-49ea-b564-1d1525a31910 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:05.420025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-566c7d48-6371-49ea-b564-1d1525a31910 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:05.480548 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-566c7d48-6371-49ea-b564-1d1525a31910 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:05.488517 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-566c7d48-6371-49ea-b564-1d1525a31910 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081033 Apr 12 15:07:05.489417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 615/1205] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:05 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:06.507436 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-43e39cfe-ca24-4f29-99fe-cc6a2c7dc5e8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:06.508103 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-43e39cfe-ca24-4f29-99fe-cc6a2c7dc5e8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:06.514035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43e39cfe-ca24-4f29-99fe-cc6a2c7dc5e8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:06.514478 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43e39cfe-ca24-4f29-99fe-cc6a2c7dc5e8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:06.515238 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43e39cfe-ca24-4f29-99fe-cc6a2c7dc5e8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:06.515670 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43e39cfe-ca24-4f29-99fe-cc6a2c7dc5e8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:06.575267 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-43e39cfe-ca24-4f29-99fe-cc6a2c7dc5e8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:06.582895 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-43e39cfe-ca24-4f29-99fe-cc6a2c7dc5e8 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080079 Apr 12 15:07:06.583480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 591/1206] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:06 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:07.602075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-feb06fc1-1c23-4c2a-b450-3325defe9e63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:07.602889 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-feb06fc1-1c23-4c2a-b450-3325defe9e63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:07.609113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-feb06fc1-1c23-4c2a-b450-3325defe9e63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:07.609559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-feb06fc1-1c23-4c2a-b450-3325defe9e63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:07.610363 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-feb06fc1-1c23-4c2a-b450-3325defe9e63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:07.610795 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-feb06fc1-1c23-4c2a-b450-3325defe9e63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:07.674555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-feb06fc1-1c23-4c2a-b450-3325defe9e63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:07.682753 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-feb06fc1-1c23-4c2a-b450-3325defe9e63 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085119 Apr 12 15:07:07.683330 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 616/1207] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:07 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:08.701422 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f9841780-0b64-43b8-b8c1-7fff82861b7b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:08.702065 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f9841780-0b64-43b8-b8c1-7fff82861b7b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:08.708434 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9841780-0b64-43b8-b8c1-7fff82861b7b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:08.708860 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9841780-0b64-43b8-b8c1-7fff82861b7b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:08.709623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9841780-0b64-43b8-b8c1-7fff82861b7b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:08.710130 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9841780-0b64-43b8-b8c1-7fff82861b7b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:08.775301 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f9841780-0b64-43b8-b8c1-7fff82861b7b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:08.783530 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f9841780-0b64-43b8-b8c1-7fff82861b7b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086950 Apr 12 15:07:08.784037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 592/1208] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:08 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:09.800202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dce15e76-921a-45ad-bc25-2132b1571da5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:09.800885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dce15e76-921a-45ad-bc25-2132b1571da5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:09.808261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dce15e76-921a-45ad-bc25-2132b1571da5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:09.808709 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dce15e76-921a-45ad-bc25-2132b1571da5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:09.809484 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dce15e76-921a-45ad-bc25-2132b1571da5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:09.809954 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dce15e76-921a-45ad-bc25-2132b1571da5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:09.870200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dce15e76-921a-45ad-bc25-2132b1571da5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:09.877986 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dce15e76-921a-45ad-bc25-2132b1571da5 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081547 Apr 12 15:07:09.880106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 617/1209] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:09 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:10.894716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-29008dcf-d3d5-4190-8a04-d844439e7be9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:10.895325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-29008dcf-d3d5-4190-8a04-d844439e7be9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:10.902531 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-29008dcf-d3d5-4190-8a04-d844439e7be9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:10.903067 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-29008dcf-d3d5-4190-8a04-d844439e7be9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:10.903777 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-29008dcf-d3d5-4190-8a04-d844439e7be9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:10.904182 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-29008dcf-d3d5-4190-8a04-d844439e7be9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:10.964565 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-29008dcf-d3d5-4190-8a04-d844439e7be9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:10.971854 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-29008dcf-d3d5-4190-8a04-d844439e7be9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080916 Apr 12 15:07:10.972411 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 593/1210] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:10 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:11.990585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-19f6c794-a88b-4cae-89b0-b38bef300ca7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:11.991805 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-19f6c794-a88b-4cae-89b0-b38bef300ca7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:11.998347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19f6c794-a88b-4cae-89b0-b38bef300ca7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:11.998787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19f6c794-a88b-4cae-89b0-b38bef300ca7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:11.999538 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19f6c794-a88b-4cae-89b0-b38bef300ca7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:11.999960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-19f6c794-a88b-4cae-89b0-b38bef300ca7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:12.066558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-19f6c794-a88b-4cae-89b0-b38bef300ca7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:12.075540 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-19f6c794-a88b-4cae-89b0-b38bef300ca7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.088608 Apr 12 15:07:12.075907 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 618/1211] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:11 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:13.092242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-728d7c9a-14ea-4f28-b8fb-199204ce9d96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:13.092840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-728d7c9a-14ea-4f28-b8fb-199204ce9d96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:13.099040 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-728d7c9a-14ea-4f28-b8fb-199204ce9d96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:13.099479 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-728d7c9a-14ea-4f28-b8fb-199204ce9d96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:13.100814 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-728d7c9a-14ea-4f28-b8fb-199204ce9d96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:13.101949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-728d7c9a-14ea-4f28-b8fb-199204ce9d96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:13.161559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-728d7c9a-14ea-4f28-b8fb-199204ce9d96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:13.169559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-728d7c9a-14ea-4f28-b8fb-199204ce9d96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081186 Apr 12 15:07:13.170155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 594/1212] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:13 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:07:14.187288 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bd7d64c0-e951-4a81-8ff6-a5869673df4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:14.188007 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bd7d64c0-e951-4a81-8ff6-a5869673df4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:14.194743 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd7d64c0-e951-4a81-8ff6-a5869673df4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:14.195182 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd7d64c0-e951-4a81-8ff6-a5869673df4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:14.196149 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd7d64c0-e951-4a81-8ff6-a5869673df4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:14.196821 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd7d64c0-e951-4a81-8ff6-a5869673df4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:14.258546 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bd7d64c0-e951-4a81-8ff6-a5869673df4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:14.266027 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bd7d64c0-e951-4a81-8ff6-a5869673df4c tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083993 Apr 12 15:07:14.266595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 619/1213] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:14 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:07:15.284035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ef6520a1-69f3-4fa1-87f5-9542844a2605 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:15.284639 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ef6520a1-69f3-4fa1-87f5-9542844a2605 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:15.291518 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ef6520a1-69f3-4fa1-87f5-9542844a2605 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:15.291960 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ef6520a1-69f3-4fa1-87f5-9542844a2605 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:15.292723 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ef6520a1-69f3-4fa1-87f5-9542844a2605 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:15.293420 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ef6520a1-69f3-4fa1-87f5-9542844a2605 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:15.357105 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ef6520a1-69f3-4fa1-87f5-9542844a2605 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:15.367132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ef6520a1-69f3-4fa1-87f5-9542844a2605 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085839 Apr 12 15:07:15.367705 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 595/1214] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:15 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:16.384494 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0fe77da2-e08c-4342-b4de-7065f7a857bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:16.385017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0fe77da2-e08c-4342-b4de-7065f7a857bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:16.391431 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0fe77da2-e08c-4342-b4de-7065f7a857bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:16.391879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0fe77da2-e08c-4342-b4de-7065f7a857bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:16.392674 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0fe77da2-e08c-4342-b4de-7065f7a857bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:16.393112 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0fe77da2-e08c-4342-b4de-7065f7a857bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:16.460458 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0fe77da2-e08c-4342-b4de-7065f7a857bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:16.468234 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0fe77da2-e08c-4342-b4de-7065f7a857bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.087774 Apr 12 15:07:16.468808 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 620/1215] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:16 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:17.485652 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3bcae2ef-9e06-4296-bb7d-de5e3b314e96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:17.486183 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3bcae2ef-9e06-4296-bb7d-de5e3b314e96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:17.493808 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3bcae2ef-9e06-4296-bb7d-de5e3b314e96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:17.494247 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3bcae2ef-9e06-4296-bb7d-de5e3b314e96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:17.495010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3bcae2ef-9e06-4296-bb7d-de5e3b314e96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:17.495433 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3bcae2ef-9e06-4296-bb7d-de5e3b314e96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:17.556040 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3bcae2ef-9e06-4296-bb7d-de5e3b314e96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:17.563761 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3bcae2ef-9e06-4296-bb7d-de5e3b314e96 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081999 Apr 12 15:07:17.564325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 596/1216] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:17 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:18.580897 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bd68bd6d-1cdd-4797-a1bd-c17ff606d5b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:18.581663 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bd68bd6d-1cdd-4797-a1bd-c17ff606d5b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:18.588291 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd68bd6d-1cdd-4797-a1bd-c17ff606d5b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:18.588840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd68bd6d-1cdd-4797-a1bd-c17ff606d5b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:18.589611 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd68bd6d-1cdd-4797-a1bd-c17ff606d5b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:18.590079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd68bd6d-1cdd-4797-a1bd-c17ff606d5b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:18.655381 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bd68bd6d-1cdd-4797-a1bd-c17ff606d5b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:18.663118 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bd68bd6d-1cdd-4797-a1bd-c17ff606d5b7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086286 Apr 12 15:07:18.663698 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 621/1217] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:18 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:19.682806 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9b30f0a0-ab33-4f6b-80b7-b9ef9f6ab8d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:19.683524 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9b30f0a0-ab33-4f6b-80b7-b9ef9f6ab8d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:19.690302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b30f0a0-ab33-4f6b-80b7-b9ef9f6ab8d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:19.690831 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b30f0a0-ab33-4f6b-80b7-b9ef9f6ab8d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:19.691842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b30f0a0-ab33-4f6b-80b7-b9ef9f6ab8d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:19.692281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9b30f0a0-ab33-4f6b-80b7-b9ef9f6ab8d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:19.754450 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9b30f0a0-ab33-4f6b-80b7-b9ef9f6ab8d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:19.762799 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9b30f0a0-ab33-4f6b-80b7-b9ef9f6ab8d7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084081 Apr 12 15:07:19.763372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 597/1218] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:19 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:20.780406 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9e9f4806-ac66-4751-a244-a291e808bcae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:20.781095 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9e9f4806-ac66-4751-a244-a291e808bcae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:20.787322 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e9f4806-ac66-4751-a244-a291e808bcae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:20.787758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e9f4806-ac66-4751-a244-a291e808bcae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:20.788604 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e9f4806-ac66-4751-a244-a291e808bcae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:20.789114 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9e9f4806-ac66-4751-a244-a291e808bcae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:20.862864 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9e9f4806-ac66-4751-a244-a291e808bcae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:20.871393 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9e9f4806-ac66-4751-a244-a291e808bcae tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.094973 Apr 12 15:07:20.871975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 622/1219] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:20 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:07:21.888007 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d75b32c6-9474-4f92-aec4-3b74fb69958e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:21.888687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d75b32c6-9474-4f92-aec4-3b74fb69958e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:21.895027 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d75b32c6-9474-4f92-aec4-3b74fb69958e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:21.895549 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d75b32c6-9474-4f92-aec4-3b74fb69958e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:21.896308 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d75b32c6-9474-4f92-aec4-3b74fb69958e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:21.896759 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d75b32c6-9474-4f92-aec4-3b74fb69958e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:21.963088 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d75b32c6-9474-4f92-aec4-3b74fb69958e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:21.970483 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d75b32c6-9474-4f92-aec4-3b74fb69958e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086379 Apr 12 15:07:21.971042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 598/1220] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:21 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:22.987613 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b4c05efa-bd25-4899-9a7d-5e88d8aa0142 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:22.988151 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b4c05efa-bd25-4899-9a7d-5e88d8aa0142 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:22.995171 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4c05efa-bd25-4899-9a7d-5e88d8aa0142 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:22.995619 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4c05efa-bd25-4899-9a7d-5e88d8aa0142 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:22.996385 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4c05efa-bd25-4899-9a7d-5e88d8aa0142 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:22.996815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b4c05efa-bd25-4899-9a7d-5e88d8aa0142 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:23.059513 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b4c05efa-bd25-4899-9a7d-5e88d8aa0142 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:23.066869 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b4c05efa-bd25-4899-9a7d-5e88d8aa0142 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083233 Apr 12 15:07:23.067428 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 623/1221] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:22 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:24.085107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c2161731-56df-477f-ba30-13fb9a129bdd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:24.085784 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c2161731-56df-477f-ba30-13fb9a129bdd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:24.092048 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c2161731-56df-477f-ba30-13fb9a129bdd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:24.092491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c2161731-56df-477f-ba30-13fb9a129bdd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:24.093289 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c2161731-56df-477f-ba30-13fb9a129bdd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:24.093759 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c2161731-56df-477f-ba30-13fb9a129bdd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:24.155109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c2161731-56df-477f-ba30-13fb9a129bdd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:24.162577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c2161731-56df-477f-ba30-13fb9a129bdd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082115 Apr 12 15:07:24.163261 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 599/1222] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:24 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:25.180070 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-debb465b-cb17-4a27-ac34-d3fddcbbc735 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:25.180596 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-debb465b-cb17-4a27-ac34-d3fddcbbc735 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:25.187392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-debb465b-cb17-4a27-ac34-d3fddcbbc735 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:25.187587 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-debb465b-cb17-4a27-ac34-d3fddcbbc735 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:25.188347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-debb465b-cb17-4a27-ac34-d3fddcbbc735 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:25.188771 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-debb465b-cb17-4a27-ac34-d3fddcbbc735 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:25.248265 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-debb465b-cb17-4a27-ac34-d3fddcbbc735 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:25.255572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-debb465b-cb17-4a27-ac34-d3fddcbbc735 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080176 Apr 12 15:07:25.256189 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 624/1223] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:25 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:26.484573 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b73b09ac-e54b-499b-9e5b-8432e0846f8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:26.485183 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b73b09ac-e54b-499b-9e5b-8432e0846f8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:26.491354 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b73b09ac-e54b-499b-9e5b-8432e0846f8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:26.491805 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b73b09ac-e54b-499b-9e5b-8432e0846f8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:26.492563 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b73b09ac-e54b-499b-9e5b-8432e0846f8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:26.492993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b73b09ac-e54b-499b-9e5b-8432e0846f8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:26.552590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b73b09ac-e54b-499b-9e5b-8432e0846f8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:26.561300 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b73b09ac-e54b-499b-9e5b-8432e0846f8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.292716 Apr 12 15:07:26.561880 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 600/1224] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:26 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:27.579359 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9ca21b8a-b702-484a-ac05-54f78f20cb89 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:27.579987 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9ca21b8a-b702-484a-ac05-54f78f20cb89 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:27.587315 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ca21b8a-b702-484a-ac05-54f78f20cb89 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:27.587758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ca21b8a-b702-484a-ac05-54f78f20cb89 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:27.588504 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ca21b8a-b702-484a-ac05-54f78f20cb89 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:27.588927 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ca21b8a-b702-484a-ac05-54f78f20cb89 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:27.648378 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ca21b8a-b702-484a-ac05-54f78f20cb89 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:27.655599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9ca21b8a-b702-484a-ac05-54f78f20cb89 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080436 Apr 12 15:07:27.656151 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 625/1225] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:27 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:07:28.672857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e4ce567e-a1ed-42d5-80fb-dd4871f303a0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:28.673502 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e4ce567e-a1ed-42d5-80fb-dd4871f303a0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:28.679977 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4ce567e-a1ed-42d5-80fb-dd4871f303a0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:28.680451 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4ce567e-a1ed-42d5-80fb-dd4871f303a0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:28.681218 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4ce567e-a1ed-42d5-80fb-dd4871f303a0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:28.681667 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4ce567e-a1ed-42d5-80fb-dd4871f303a0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:28.741612 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e4ce567e-a1ed-42d5-80fb-dd4871f303a0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:28.749064 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e4ce567e-a1ed-42d5-80fb-dd4871f303a0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080084 Apr 12 15:07:28.749649 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 601/1226] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:28 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:29.765506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-73b2d5b7-ff3e-49e2-8b9b-81bd8e65af7f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:29.766155 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-73b2d5b7-ff3e-49e2-8b9b-81bd8e65af7f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:29.772611 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73b2d5b7-ff3e-49e2-8b9b-81bd8e65af7f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:29.773061 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73b2d5b7-ff3e-49e2-8b9b-81bd8e65af7f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:29.773854 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73b2d5b7-ff3e-49e2-8b9b-81bd8e65af7f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:29.774290 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73b2d5b7-ff3e-49e2-8b9b-81bd8e65af7f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:29.836073 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-73b2d5b7-ff3e-49e2-8b9b-81bd8e65af7f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:29.843443 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-73b2d5b7-ff3e-49e2-8b9b-81bd8e65af7f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081810 Apr 12 15:07:29.844006 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 626/1227] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:29 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:30.860410 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d3f57ac5-038e-49a4-ba8c-8d577d21437d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:30.860986 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d3f57ac5-038e-49a4-ba8c-8d577d21437d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:30.867413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d3f57ac5-038e-49a4-ba8c-8d577d21437d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:30.867859 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d3f57ac5-038e-49a4-ba8c-8d577d21437d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:30.868627 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d3f57ac5-038e-49a4-ba8c-8d577d21437d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:30.869058 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d3f57ac5-038e-49a4-ba8c-8d577d21437d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:30.928850 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d3f57ac5-038e-49a4-ba8c-8d577d21437d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:30.936414 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d3f57ac5-038e-49a4-ba8c-8d577d21437d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079965 Apr 12 15:07:30.936982 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 602/1228] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:30 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:31.953950 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-eb4fdc5e-33c0-400d-8936-6e63921212a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:31.954504 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-eb4fdc5e-33c0-400d-8936-6e63921212a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:31.961284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eb4fdc5e-33c0-400d-8936-6e63921212a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:31.961747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eb4fdc5e-33c0-400d-8936-6e63921212a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:31.962505 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eb4fdc5e-33c0-400d-8936-6e63921212a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:31.962926 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-eb4fdc5e-33c0-400d-8936-6e63921212a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:32.022495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-eb4fdc5e-33c0-400d-8936-6e63921212a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:32.029765 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-eb4fdc5e-33c0-400d-8936-6e63921212a7 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079804 Apr 12 15:07:32.030325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 627/1229] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:31 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:33.047029 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-adca2d08-af11-4de8-af05-dbd58c5017a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:33.047623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-adca2d08-af11-4de8-af05-dbd58c5017a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:33.054083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-adca2d08-af11-4de8-af05-dbd58c5017a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:33.054528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-adca2d08-af11-4de8-af05-dbd58c5017a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:33.055288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-adca2d08-af11-4de8-af05-dbd58c5017a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:33.055718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-adca2d08-af11-4de8-af05-dbd58c5017a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:33.118221 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-adca2d08-af11-4de8-af05-dbd58c5017a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:33.124135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-adca2d08-af11-4de8-af05-dbd58c5017a9 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080908 Apr 12 15:07:33.125076 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 603/1230] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:33 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:34.142075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-37dc26a1-d9be-4944-aa1b-79416f2b7fe6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:34.142794 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-37dc26a1-d9be-4944-aa1b-79416f2b7fe6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:34.149836 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-37dc26a1-d9be-4944-aa1b-79416f2b7fe6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:34.150290 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-37dc26a1-d9be-4944-aa1b-79416f2b7fe6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:34.151058 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-37dc26a1-d9be-4944-aa1b-79416f2b7fe6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:34.151498 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-37dc26a1-d9be-4944-aa1b-79416f2b7fe6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:34.214535 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-37dc26a1-d9be-4944-aa1b-79416f2b7fe6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:34.222227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-37dc26a1-d9be-4944-aa1b-79416f2b7fe6 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084239 Apr 12 15:07:34.222797 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 628/1231] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:34 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:35.240861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fae38b5c-f4d3-48b5-a04a-124606926abb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:35.241467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fae38b5c-f4d3-48b5-a04a-124606926abb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:35.247711 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fae38b5c-f4d3-48b5-a04a-124606926abb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:35.248150 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fae38b5c-f4d3-48b5-a04a-124606926abb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:35.248897 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fae38b5c-f4d3-48b5-a04a-124606926abb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:35.249325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fae38b5c-f4d3-48b5-a04a-124606926abb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:35.311273 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fae38b5c-f4d3-48b5-a04a-124606926abb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:35.320374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fae38b5c-f4d3-48b5-a04a-124606926abb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083840 Apr 12 15:07:35.320964 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 604/1232] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:35 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:36.338259 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a112ddef-3cfa-4bf3-b966-eac3049c02bb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:36.338871 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a112ddef-3cfa-4bf3-b966-eac3049c02bb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:36.345073 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a112ddef-3cfa-4bf3-b966-eac3049c02bb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:36.345523 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a112ddef-3cfa-4bf3-b966-eac3049c02bb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:36.346313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a112ddef-3cfa-4bf3-b966-eac3049c02bb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:36.346752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a112ddef-3cfa-4bf3-b966-eac3049c02bb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:36.425572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a112ddef-3cfa-4bf3-b966-eac3049c02bb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:36.434042 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a112ddef-3cfa-4bf3-b966-eac3049c02bb tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.099541 Apr 12 15:07:36.434712 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 629/1233] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:36 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:37.450867 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-353efd52-d9fc-440a-b9eb-729343fe6c1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:37.451472 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-353efd52-d9fc-440a-b9eb-729343fe6c1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:37.457306 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-353efd52-d9fc-440a-b9eb-729343fe6c1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:37.457784 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-353efd52-d9fc-440a-b9eb-729343fe6c1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:37.458658 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-353efd52-d9fc-440a-b9eb-729343fe6c1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:37.459109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-353efd52-d9fc-440a-b9eb-729343fe6c1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:37.521967 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-353efd52-d9fc-440a-b9eb-729343fe6c1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:37.529775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-353efd52-d9fc-440a-b9eb-729343fe6c1d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082556 Apr 12 15:07:37.530359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 605/1234] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:37 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:38.546710 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-17b84cfd-86b2-451d-b91a-7d28b06bbd8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:38.547557 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-17b84cfd-86b2-451d-b91a-7d28b06bbd8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:38.554708 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-17b84cfd-86b2-451d-b91a-7d28b06bbd8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:38.555156 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-17b84cfd-86b2-451d-b91a-7d28b06bbd8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:38.555927 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-17b84cfd-86b2-451d-b91a-7d28b06bbd8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:38.556358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-17b84cfd-86b2-451d-b91a-7d28b06bbd8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:38.619544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-17b84cfd-86b2-451d-b91a-7d28b06bbd8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:38.627179 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-17b84cfd-86b2-451d-b91a-7d28b06bbd8e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084379 Apr 12 15:07:38.627734 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 630/1235] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:38 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:39.643704 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-29d1ad9d-0114-4b92-a53d-4b79cf02c565 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:39.644345 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-29d1ad9d-0114-4b92-a53d-4b79cf02c565 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:39.651352 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-29d1ad9d-0114-4b92-a53d-4b79cf02c565 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:39.651797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-29d1ad9d-0114-4b92-a53d-4b79cf02c565 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:39.652553 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-29d1ad9d-0114-4b92-a53d-4b79cf02c565 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:39.652984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-29d1ad9d-0114-4b92-a53d-4b79cf02c565 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:39.713528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-29d1ad9d-0114-4b92-a53d-4b79cf02c565 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:39.721185 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-29d1ad9d-0114-4b92-a53d-4b79cf02c565 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081319 Apr 12 15:07:39.724224 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 606/1236] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:39 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:40.737946 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c5ee7b80-3f13-4f71-8285-752d4ddf079e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:40.738584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c5ee7b80-3f13-4f71-8285-752d4ddf079e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:40.745566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5ee7b80-3f13-4f71-8285-752d4ddf079e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:40.746042 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5ee7b80-3f13-4f71-8285-752d4ddf079e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:40.746829 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5ee7b80-3f13-4f71-8285-752d4ddf079e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:40.747266 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5ee7b80-3f13-4f71-8285-752d4ddf079e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:40.806374 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c5ee7b80-3f13-4f71-8285-752d4ddf079e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:40.814084 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c5ee7b80-3f13-4f71-8285-752d4ddf079e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079995 Apr 12 15:07:40.814642 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 631/1237] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:40 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:41.830759 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e4979a55-f51f-4765-9b68-3a81b8387a41 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:41.831312 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e4979a55-f51f-4765-9b68-3a81b8387a41 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:41.837515 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4979a55-f51f-4765-9b68-3a81b8387a41 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:41.837983 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4979a55-f51f-4765-9b68-3a81b8387a41 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:41.838732 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4979a55-f51f-4765-9b68-3a81b8387a41 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:41.839155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4979a55-f51f-4765-9b68-3a81b8387a41 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:41.905704 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e4979a55-f51f-4765-9b68-3a81b8387a41 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:41.913275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e4979a55-f51f-4765-9b68-3a81b8387a41 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086418 Apr 12 15:07:41.913892 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 607/1238] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:41 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:42.930341 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7a27407d-30db-4a92-af94-e96d54064fa0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:42.930879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7a27407d-30db-4a92-af94-e96d54064fa0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:42.937671 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7a27407d-30db-4a92-af94-e96d54064fa0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:42.938117 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7a27407d-30db-4a92-af94-e96d54064fa0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:42.938897 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7a27407d-30db-4a92-af94-e96d54064fa0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:42.939324 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7a27407d-30db-4a92-af94-e96d54064fa0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:43.013095 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7a27407d-30db-4a92-af94-e96d54064fa0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:43.020682 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7a27407d-30db-4a92-af94-e96d54064fa0 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.094236 Apr 12 15:07:43.022178 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 632/1239] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:42 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:44.039128 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e4a78956-f699-4300-8fe4-8bc36fcc9429 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:44.039684 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e4a78956-f699-4300-8fe4-8bc36fcc9429 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:44.046290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4a78956-f699-4300-8fe4-8bc36fcc9429 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:44.046735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4a78956-f699-4300-8fe4-8bc36fcc9429 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:44.047506 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4a78956-f699-4300-8fe4-8bc36fcc9429 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:44.047935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e4a78956-f699-4300-8fe4-8bc36fcc9429 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:44.110640 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e4a78956-f699-4300-8fe4-8bc36fcc9429 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:44.119698 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e4a78956-f699-4300-8fe4-8bc36fcc9429 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084589 Apr 12 15:07:44.120291 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 608/1240] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:44 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:45.137924 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0baa0be9-a01e-4cab-9c7a-e0c72d52333a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:45.138615 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0baa0be9-a01e-4cab-9c7a-e0c72d52333a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:45.147094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0baa0be9-a01e-4cab-9c7a-e0c72d52333a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:45.147527 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0baa0be9-a01e-4cab-9c7a-e0c72d52333a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:45.148287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0baa0be9-a01e-4cab-9c7a-e0c72d52333a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:45.148735 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0baa0be9-a01e-4cab-9c7a-e0c72d52333a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:45.210614 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0baa0be9-a01e-4cab-9c7a-e0c72d52333a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:45.218185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0baa0be9-a01e-4cab-9c7a-e0c72d52333a tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085129 Apr 12 15:07:45.218761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 633/1241] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:45 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:45.597030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:07:45.597220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:07:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:07:46.235292 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2e55a154-0088-4fb8-84c4-63b309ab7f1f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:46.235824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2e55a154-0088-4fb8-84c4-63b309ab7f1f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:46.243001 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e55a154-0088-4fb8-84c4-63b309ab7f1f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:46.243447 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e55a154-0088-4fb8-84c4-63b309ab7f1f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:46.244214 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e55a154-0088-4fb8-84c4-63b309ab7f1f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:46.244645 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2e55a154-0088-4fb8-84c4-63b309ab7f1f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:46.311071 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2e55a154-0088-4fb8-84c4-63b309ab7f1f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:46.319083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2e55a154-0088-4fb8-84c4-63b309ab7f1f tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.087651 Apr 12 15:07:46.319696 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 609/1242] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:46 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:47.022674 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:07:47.022857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:07:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:07:47.336198 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9c84f9fb-e0f6-4a61-8b2b-bec08b6426ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:47.336810 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9c84f9fb-e0f6-4a61-8b2b-bec08b6426ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:47.343239 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c84f9fb-e0f6-4a61-8b2b-bec08b6426ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:47.343718 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c84f9fb-e0f6-4a61-8b2b-bec08b6426ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:47.344542 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c84f9fb-e0f6-4a61-8b2b-bec08b6426ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:47.345025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9c84f9fb-e0f6-4a61-8b2b-bec08b6426ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:47.412887 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9c84f9fb-e0f6-4a61-8b2b-bec08b6426ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:47.420510 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9c84f9fb-e0f6-4a61-8b2b-bec08b6426ea tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.088493 Apr 12 15:07:47.421106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 634/1243] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:47 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:48.439218 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-631d2e27-ff94-47b0-90aa-64ddcc39644d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:48.439852 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-631d2e27-ff94-47b0-90aa-64ddcc39644d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:48.447035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-631d2e27-ff94-47b0-90aa-64ddcc39644d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:48.447477 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-631d2e27-ff94-47b0-90aa-64ddcc39644d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:48.448243 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-631d2e27-ff94-47b0-90aa-64ddcc39644d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:48.448672 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-631d2e27-ff94-47b0-90aa-64ddcc39644d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:48.513387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-631d2e27-ff94-47b0-90aa-64ddcc39644d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:48.521447 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-631d2e27-ff94-47b0-90aa-64ddcc39644d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085533 Apr 12 15:07:48.522217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 610/1244] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:48 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:07:49.539877 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f974a9e5-3304-464d-a4ec-d949a4f32088 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:49.540589 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f974a9e5-3304-464d-a4ec-d949a4f32088 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:49.547316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f974a9e5-3304-464d-a4ec-d949a4f32088 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:49.547773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f974a9e5-3304-464d-a4ec-d949a4f32088 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:49.548543 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f974a9e5-3304-464d-a4ec-d949a4f32088 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:49.548979 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f974a9e5-3304-464d-a4ec-d949a4f32088 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:49.610540 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f974a9e5-3304-464d-a4ec-d949a4f32088 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:49.617941 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f974a9e5-3304-464d-a4ec-d949a4f32088 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083115 Apr 12 15:07:49.618507 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 635/1245] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:49 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:50.635896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4338825f-6ebd-4709-a1bc-2c82e36665ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:50.636509 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4338825f-6ebd-4709-a1bc-2c82e36665ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:50.642802 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4338825f-6ebd-4709-a1bc-2c82e36665ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:50.643247 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4338825f-6ebd-4709-a1bc-2c82e36665ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:50.644021 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4338825f-6ebd-4709-a1bc-2c82e36665ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:50.644449 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4338825f-6ebd-4709-a1bc-2c82e36665ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:50.704403 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4338825f-6ebd-4709-a1bc-2c82e36665ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:50.712152 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4338825f-6ebd-4709-a1bc-2c82e36665ec tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080206 Apr 12 15:07:50.712713 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 611/1246] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:50 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:51.734764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-08c14ef5-5698-493e-9a0f-e4c71b5afec3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:51.735410 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-08c14ef5-5698-493e-9a0f-e4c71b5afec3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:51.742113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08c14ef5-5698-493e-9a0f-e4c71b5afec3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:51.742560 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08c14ef5-5698-493e-9a0f-e4c71b5afec3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:51.743338 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08c14ef5-5698-493e-9a0f-e4c71b5afec3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:51.743769 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08c14ef5-5698-493e-9a0f-e4c71b5afec3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:51.809060 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-08c14ef5-5698-493e-9a0f-e4c71b5afec3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:51.817887 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-08c14ef5-5698-493e-9a0f-e4c71b5afec3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.086386 Apr 12 15:07:51.818622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 636/1247] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:51 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:52.834886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e9dedb83-4960-4bbc-9cce-90c063458424 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:52.835456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e9dedb83-4960-4bbc-9cce-90c063458424 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:52.841930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e9dedb83-4960-4bbc-9cce-90c063458424 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:52.842374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e9dedb83-4960-4bbc-9cce-90c063458424 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:52.843142 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e9dedb83-4960-4bbc-9cce-90c063458424 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:52.843571 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e9dedb83-4960-4bbc-9cce-90c063458424 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:52.903876 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e9dedb83-4960-4bbc-9cce-90c063458424 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:52.912055 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e9dedb83-4960-4bbc-9cce-90c063458424 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.080604 Apr 12 15:07:52.912639 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 612/1248] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:52 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:53.929776 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-370af9d6-56fe-471e-ba71-90717642b7d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:53.930363 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-370af9d6-56fe-471e-ba71-90717642b7d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:53.936724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-370af9d6-56fe-471e-ba71-90717642b7d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:53.937163 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-370af9d6-56fe-471e-ba71-90717642b7d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:53.937943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-370af9d6-56fe-471e-ba71-90717642b7d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:53.938372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-370af9d6-56fe-471e-ba71-90717642b7d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:53.999275 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-370af9d6-56fe-471e-ba71-90717642b7d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:54.007928 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-370af9d6-56fe-471e-ba71-90717642b7d3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082714 Apr 12 15:07:54.008488 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 637/1249] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:53 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:55.024930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c1589201-ab81-4919-9be9-8076b2e26890 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:55.025538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c1589201-ab81-4919-9be9-8076b2e26890 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:55.031803 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1589201-ab81-4919-9be9-8076b2e26890 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:55.032226 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1589201-ab81-4919-9be9-8076b2e26890 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:55.032998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1589201-ab81-4919-9be9-8076b2e26890 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:55.033408 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c1589201-ab81-4919-9be9-8076b2e26890 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:55.093932 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c1589201-ab81-4919-9be9-8076b2e26890 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:55.102259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c1589201-ab81-4919-9be9-8076b2e26890 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.081772 Apr 12 15:07:55.102817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 613/1250] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:55 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:56.120606 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5d70131c-ab50-4192-ade3-c77f209f32cf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:56.121202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5d70131c-ab50-4192-ade3-c77f209f32cf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:56.127588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5d70131c-ab50-4192-ade3-c77f209f32cf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:56.128032 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5d70131c-ab50-4192-ade3-c77f209f32cf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:56.128796 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5d70131c-ab50-4192-ade3-c77f209f32cf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:56.129225 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5d70131c-ab50-4192-ade3-c77f209f32cf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:56.193426 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5d70131c-ab50-4192-ade3-c77f209f32cf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:56.200979 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5d70131c-ab50-4192-ade3-c77f209f32cf tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084325 Apr 12 15:07:56.201544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 638/1251] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:56 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:57.218432 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9d773827-a239-4eff-a1e5-37ced881ba28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:57.219334 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9d773827-a239-4eff-a1e5-37ced881ba28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:57.226825 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d773827-a239-4eff-a1e5-37ced881ba28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:57.227266 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d773827-a239-4eff-a1e5-37ced881ba28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:57.228031 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d773827-a239-4eff-a1e5-37ced881ba28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:57.228464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9d773827-a239-4eff-a1e5-37ced881ba28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:57.298801 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9d773827-a239-4eff-a1e5-37ced881ba28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:57.306580 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9d773827-a239-4eff-a1e5-37ced881ba28 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.092394 Apr 12 15:07:57.307143 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 614/1252] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:57 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:58.324284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4657080d-40d1-4ea2-bc05-228702820797 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:58.324905 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4657080d-40d1-4ea2-bc05-228702820797 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:58.331239 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4657080d-40d1-4ea2-bc05-228702820797 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:58.331680 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4657080d-40d1-4ea2-bc05-228702820797 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:58.332451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4657080d-40d1-4ea2-bc05-228702820797 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:58.332884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4657080d-40d1-4ea2-bc05-228702820797 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:58.394355 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4657080d-40d1-4ea2-bc05-228702820797 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:58.403289 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4657080d-40d1-4ea2-bc05-228702820797 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.082917 Apr 12 15:07:58.403866 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 639/1253] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:58 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:59.421281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bed57360-a908-4f0e-a98e-5866c35ce334 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:07:59.421895 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bed57360-a908-4f0e-a98e-5866c35ce334 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:07:59.428925 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bed57360-a908-4f0e-a98e-5866c35ce334 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:59.429376 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bed57360-a908-4f0e-a98e-5866c35ce334 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:59.430202 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bed57360-a908-4f0e-a98e-5866c35ce334 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:07:59.430643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bed57360-a908-4f0e-a98e-5866c35ce334 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:07:59.500028 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bed57360-a908-4f0e-a98e-5866c35ce334 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:07:59.507946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bed57360-a908-4f0e-a98e-5866c35ce334 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.090641 Apr 12 15:07:59.512849 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 615/1254] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:07:59 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:07:59.687572 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:07:59.687749 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:07:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:08:00.524319 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-feddc0c7-6205-4ff5-9339-da986e0428fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:00.525013 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-feddc0c7-6205-4ff5-9339-da986e0428fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:00.531648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-feddc0c7-6205-4ff5-9339-da986e0428fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:00.532177 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-feddc0c7-6205-4ff5-9339-da986e0428fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:00.533062 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-feddc0c7-6205-4ff5-9339-da986e0428fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:00.533503 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-feddc0c7-6205-4ff5-9339-da986e0428fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:00.609785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-feddc0c7-6205-4ff5-9339-da986e0428fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:00.619972 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-feddc0c7-6205-4ff5-9339-da986e0428fd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.099640 Apr 12 15:08:00.620675 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 640/1255] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:00 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:01.636743 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1fee809e-0740-446e-8fe4-2bc5f54046c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:01.637525 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1fee809e-0740-446e-8fe4-2bc5f54046c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:01.644303 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1fee809e-0740-446e-8fe4-2bc5f54046c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:01.644678 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1fee809e-0740-446e-8fe4-2bc5f54046c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:01.645525 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1fee809e-0740-446e-8fe4-2bc5f54046c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:01.645983 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1fee809e-0740-446e-8fe4-2bc5f54046c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:01.710189 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1fee809e-0740-446e-8fe4-2bc5f54046c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:01.717652 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1fee809e-0740-446e-8fe4-2bc5f54046c3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085071 Apr 12 15:08:01.718222 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 616/1256] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:01 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:02.735215 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bd565649-f76c-404d-b2c5-572356329a87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:02.735871 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bd565649-f76c-404d-b2c5-572356329a87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:02.743078 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd565649-f76c-404d-b2c5-572356329a87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:02.743569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd565649-f76c-404d-b2c5-572356329a87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:02.744376 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd565649-f76c-404d-b2c5-572356329a87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:02.744851 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bd565649-f76c-404d-b2c5-572356329a87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:02.808015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bd565649-f76c-404d-b2c5-572356329a87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:02.815443 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bd565649-f76c-404d-b2c5-572356329a87 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084300 Apr 12 15:08:02.815998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 641/1257] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:02 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:03.832508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dbfa7a80-3e57-4ed4-b11b-2bef955c9322 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:03.834448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dbfa7a80-3e57-4ed4-b11b-2bef955c9322 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:03.841032 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbfa7a80-3e57-4ed4-b11b-2bef955c9322 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:03.841478 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbfa7a80-3e57-4ed4-b11b-2bef955c9322 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:03.842293 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbfa7a80-3e57-4ed4-b11b-2bef955c9322 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:03.842721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbfa7a80-3e57-4ed4-b11b-2bef955c9322 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:03.905788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dbfa7a80-3e57-4ed4-b11b-2bef955c9322 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:03.913889 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dbfa7a80-3e57-4ed4-b11b-2bef955c9322 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.085327 Apr 12 15:08:03.914461 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 617/1258] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:03 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:04.932034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-28cf88c0-892c-431d-a1ef-eedf407b0316 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:04.932648 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-28cf88c0-892c-431d-a1ef-eedf407b0316 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:04.939157 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28cf88c0-892c-431d-a1ef-eedf407b0316 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:04.939597 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28cf88c0-892c-431d-a1ef-eedf407b0316 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:04.940365 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28cf88c0-892c-431d-a1ef-eedf407b0316 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:04.940787 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-28cf88c0-892c-431d-a1ef-eedf407b0316 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:05.008212 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-28cf88c0-892c-431d-a1ef-eedf407b0316 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:05.015995 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-28cf88c0-892c-431d-a1ef-eedf407b0316 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.088479 Apr 12 15:08:05.016563 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 642/1259] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:04 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:06.036654 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d5594753-ff1d-4645-95c3-88184de4490d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:06.037302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d5594753-ff1d-4645-95c3-88184de4490d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:06.043122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5594753-ff1d-4645-95c3-88184de4490d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:06.043568 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5594753-ff1d-4645-95c3-88184de4490d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:06.044332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5594753-ff1d-4645-95c3-88184de4490d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:06.044764 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5594753-ff1d-4645-95c3-88184de4490d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:06.104269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d5594753-ff1d-4645-95c3-88184de4490d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:06.111829 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d5594753-ff1d-4645-95c3-88184de4490d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079411 Apr 12 15:08:06.112390 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 618/1260] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:06 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:07.131282 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-73afe1b8-0ab7-4fa3-b72c-6c37d54fba25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:07.131842 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-73afe1b8-0ab7-4fa3-b72c-6c37d54fba25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:07.138268 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73afe1b8-0ab7-4fa3-b72c-6c37d54fba25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:07.138709 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73afe1b8-0ab7-4fa3-b72c-6c37d54fba25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:07.139469 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73afe1b8-0ab7-4fa3-b72c-6c37d54fba25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:07.139934 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73afe1b8-0ab7-4fa3-b72c-6c37d54fba25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:07.205261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-73afe1b8-0ab7-4fa3-b72c-6c37d54fba25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:07.214066 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-73afe1b8-0ab7-4fa3-b72c-6c37d54fba25 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.087631 Apr 12 15:08:07.214669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 643/1261] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:07 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:08:08.231290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f60edbf5-ccc3-4cb4-a340-935220db5fa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:08.231843 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f60edbf5-ccc3-4cb4-a340-935220db5fa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:08.238181 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f60edbf5-ccc3-4cb4-a340-935220db5fa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:08.238631 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f60edbf5-ccc3-4cb4-a340-935220db5fa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:08.239401 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f60edbf5-ccc3-4cb4-a340-935220db5fa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:08.240560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f60edbf5-ccc3-4cb4-a340-935220db5fa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:08.310308 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f60edbf5-ccc3-4cb4-a340-935220db5fa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:08.317847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f60edbf5-ccc3-4cb4-a340-935220db5fa4 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.090579 Apr 12 15:08:08.318629 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 619/1262] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:08 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:09.335343 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b21b1315-2633-4984-a7d4-342cae0ba58d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:09.335955 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b21b1315-2633-4984-a7d4-342cae0ba58d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:09.342297 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b21b1315-2633-4984-a7d4-342cae0ba58d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:09.342746 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b21b1315-2633-4984-a7d4-342cae0ba58d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:09.343510 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b21b1315-2633-4984-a7d4-342cae0ba58d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:09.343942 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b21b1315-2633-4984-a7d4-342cae0ba58d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:09.405578 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b21b1315-2633-4984-a7d4-342cae0ba58d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:09.414297 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b21b1315-2633-4984-a7d4-342cae0ba58d tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.083498 Apr 12 15:08:09.414859 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 644/1263] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:09 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:10.432767 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-36f2ec2f-80f2-404d-976a-09f8ed9ee2b3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:10.433367 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-36f2ec2f-80f2-404d-976a-09f8ed9ee2b3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:10.439760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-36f2ec2f-80f2-404d-976a-09f8ed9ee2b3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:10.440207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-36f2ec2f-80f2-404d-976a-09f8ed9ee2b3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:10.440988 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-36f2ec2f-80f2-404d-976a-09f8ed9ee2b3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:10.441535 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-36f2ec2f-80f2-404d-976a-09f8ed9ee2b3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:10.505096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-36f2ec2f-80f2-404d-976a-09f8ed9ee2b3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:10.512760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-36f2ec2f-80f2-404d-976a-09f8ed9ee2b3 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084288 Apr 12 15:08:10.513327 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 620/1264] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:10 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:11.530457 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-590bf046-6145-4b3c-9c79-275d65d57033 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:11.531078 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-590bf046-6145-4b3c-9c79-275d65d57033 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:11.537591 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-590bf046-6145-4b3c-9c79-275d65d57033 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:11.538072 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-590bf046-6145-4b3c-9c79-275d65d57033 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:11.538844 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-590bf046-6145-4b3c-9c79-275d65d57033 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:11.539281 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-590bf046-6145-4b3c-9c79-275d65d57033 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:11.604066 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-590bf046-6145-4b3c-9c79-275d65d57033 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:11.611482 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-590bf046-6145-4b3c-9c79-275d65d57033 tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.084995 Apr 12 15:08:11.612046 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 645/1265] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:11 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:12.628271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8ed27628-06ca-439c-ac45-1457e98411bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:12.629936 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8ed27628-06ca-439c-ac45-1457e98411bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:12.635196 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ed27628-06ca-439c-ac45-1457e98411bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:12.635642 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ed27628-06ca-439c-ac45-1457e98411bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:12.636405 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ed27628-06ca-439c-ac45-1457e98411bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:12.636837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ed27628-06ca-439c-ac45-1457e98411bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:12.696217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8ed27628-06ca-439c-ac45-1457e98411bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:12.703560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8ed27628-06ca-439c-ac45-1457e98411bd tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.079139 Apr 12 15:08:12.704127 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 621/1266] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:12 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:13.720403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-efd2df11-f5c2-46ec-a8c9-b49f2cb7645e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:13.721011 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-efd2df11-f5c2-46ec-a8c9-b49f2cb7645e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] [instance: 7e688875-ca8d-4972-9d02-9c66a8634013] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:13.728068 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efd2df11-f5c2-46ec-a8c9-b49f2cb7645e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:13.728502 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efd2df11-f5c2-46ec-a8c9-b49f2cb7645e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:13.729278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efd2df11-f5c2-46ec-a8c9-b49f2cb7645e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:13.729739 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efd2df11-f5c2-46ec-a8c9-b49f2cb7645e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:13.797356 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-efd2df11-f5c2-46ec-a8c9-b49f2cb7645e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11e20132894393bdaf9b8fb4508ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3ab5283430466e9ab0b79750fc4e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:08:13.805889 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-efd2df11-f5c2-46ec-a8c9-b49f2cb7645e tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013" status: 200 len: 1220 microversion: 2.1 time: 0.089055 Apr 12 15:08:13.806458 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 646/1267] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:08:13 2022] GET /compute/v2.1/servers/7e688875-ca8d-4972-9d02-9c66a8634013 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:08:14.071842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8cef5339-f96b-4572-a198-2d1c42c7ee7b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] Calling method '.version_select at 0x7fbd60972e50>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:14.168138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8cef5339-f96b-4572-a198-2d1c42c7ee7b tempest-TestShelveInstance-143470934 tempest-TestShelveInstance-143470934-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1413510922" status: 202 len: 0 microversion: 2.1 time: 0.101721 Apr 12 15:08:14.168725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 622/1268] 10.222.0.64 () {58 vars in 1253 bytes} [Tue Apr 12 15:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1413510922 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 15:08:14.661513 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:08:14.662306 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:08:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:08:17.175289 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ac5280ab-aabe-41dd-acf7-c26b745a9adc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:08:17.175827 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ac5280ab-aabe-41dd-acf7-c26b745a9adc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:08:17.184434 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac5280ab-aabe-41dd-acf7-c26b745a9adc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:17.186083 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac5280ab-aabe-41dd-acf7-c26b745a9adc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:17.186083 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac5280ab-aabe-41dd-acf7-c26b745a9adc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:08:17.186306 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ac5280ab-aabe-41dd-acf7-c26b745a9adc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:08:17.273849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.objects.instance [None req-ac5280ab-aabe-41dd-acf7-c26b745a9adc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lazy-loading 'services' on Instance uuid b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 {{(pid=124199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 15:08:17.488119 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ac5280ab-aabe-41dd-acf7-c26b745a9adc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80/os-volume_attachments/33946274-36b3-45eb-8f3b-ccfd6388a216" status: 202 len: 0 microversion: 2.1 time: 0.316751 Apr 12 15:08:17.490818 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 647/1269] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Apr 12 15:08:17 2022] DELETE /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80/os-volume_attachments/33946274-36b3-45eb-8f3b-ccfd6388a216 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 15:09:17.167824 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:09:17.168516 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:11:05.607552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:11:05.608298 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:11:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:11:07.031030 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:11:07.031688 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:11:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:11:19.695668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:11:19.696355 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:11:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:11:19.727880 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:11:19.728426 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:11:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:11:34.670983 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:11:34.671609 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:11:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:12:37.176364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:12:37.177252 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:14:03.326292 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bbc5f29-79e1-46fa-bc8e-3c2352526a7e] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 15:14:03.330420 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a0051cb1-2d16-4826-8ce1-63f674ae85c5 tempest-TestVolumeBootPattern-691961796 tempest-TestVolumeBootPattern-691961796-project] Calling method '.version_select at 0x7fbd6083cc10>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:03.427916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a0051cb1-2d16-4826-8ce1-63f674ae85c5 tempest-TestVolumeBootPattern-691961796 tempest-TestVolumeBootPattern-691961796-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1325964647" status: 202 len: 0 microversion: 2.1 time: 0.103503 Apr 12 15:14:03.428506 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 623/1270] 10.222.0.64 () {58 vars in 1262 bytes} [Tue Apr 12 15:14:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1325964647 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 15:14:17.976489 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: ERROR oslo.messaging._drivers.impl_rabbit [-] [090fb861-6bc9-4f43-ab8e-93bedc0e9663] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 15:14:17.982622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2692194f-2838-41cc-b0e9-6c0544e9ad40 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:17.983207 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2692194f-2838-41cc-b0e9-6c0544e9ad40 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:18.006838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2692194f-2838-41cc-b0e9-6c0544e9ad40 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:18.006838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2692194f-2838-41cc-b0e9-6c0544e9ad40 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:18.006838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2692194f-2838-41cc-b0e9-6c0544e9ad40 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:18.006838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2692194f-2838-41cc-b0e9-6c0544e9ad40 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:18.046758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2692194f-2838-41cc-b0e9-6c0544e9ad40 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Going to try to terminate instance {{(pid=124199) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 15:14:18.387297 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2692194f-2838-41cc-b0e9-6c0544e9ad40 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 204 len: 0 microversion: 2.1 time: 0.412316 Apr 12 15:14:18.388802 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 648/1271] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:14:17 2022] DELETE /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 15:14:18.404513 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bbc5f29-79e1-46fa-bc8e-3c2352526a7e] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 35658. Apr 12 15:14:18.412230 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e3f2cb94-cad5-436b-a50b-1889b77f9c93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:18.413228 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e3f2cb94-cad5-436b-a50b-1889b77f9c93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:18.421285 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e3f2cb94-cad5-436b-a50b-1889b77f9c93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:18.421903 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e3f2cb94-cad5-436b-a50b-1889b77f9c93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:18.422966 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e3f2cb94-cad5-436b-a50b-1889b77f9c93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:18.423571 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e3f2cb94-cad5-436b-a50b-1889b77f9c93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:19.020306 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e3f2cb94-cad5-436b-a50b-1889b77f9c93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:19.030109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e3f2cb94-cad5-436b-a50b-1889b77f9c93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.636911 Apr 12 15:14:19.030639 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 624/1272] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:18 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:20.054484 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6ac5263f-b64a-4a74-b7d6-e8ec72420d16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:20.055477 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6ac5263f-b64a-4a74-b7d6-e8ec72420d16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:20.083778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] [090fb861-6bc9-4f43-ab8e-93bedc0e9663] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 35670. Apr 12 15:14:20.088352 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ac5263f-b64a-4a74-b7d6-e8ec72420d16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:20.089141 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ac5263f-b64a-4a74-b7d6-e8ec72420d16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:20.090230 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ac5263f-b64a-4a74-b7d6-e8ec72420d16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:20.090912 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6ac5263f-b64a-4a74-b7d6-e8ec72420d16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:20.517191 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6ac5263f-b64a-4a74-b7d6-e8ec72420d16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:20.527329 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6ac5263f-b64a-4a74-b7d6-e8ec72420d16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.481131 Apr 12 15:14:20.547290 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 649/1273] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:20 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:21.546617 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e94f026a-e608-410e-aa6a-5a785ce37ee3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:21.548172 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e94f026a-e608-410e-aa6a-5a785ce37ee3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:21.554885 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e94f026a-e608-410e-aa6a-5a785ce37ee3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:21.555423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e94f026a-e608-410e-aa6a-5a785ce37ee3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:21.557138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e94f026a-e608-410e-aa6a-5a785ce37ee3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:21.557592 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e94f026a-e608-410e-aa6a-5a785ce37ee3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:21.700581 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e94f026a-e608-410e-aa6a-5a785ce37ee3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:21.709110 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e94f026a-e608-410e-aa6a-5a785ce37ee3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.167212 Apr 12 15:14:21.719618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 625/1274] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:21 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:22.727011 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9ae211ed-641e-4c22-aeac-bb07b7f7e558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:22.729257 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9ae211ed-641e-4c22-aeac-bb07b7f7e558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:22.736003 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ae211ed-641e-4c22-aeac-bb07b7f7e558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:22.736921 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ae211ed-641e-4c22-aeac-bb07b7f7e558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:22.737975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ae211ed-641e-4c22-aeac-bb07b7f7e558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:22.738675 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9ae211ed-641e-4c22-aeac-bb07b7f7e558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:22.907020 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9ae211ed-641e-4c22-aeac-bb07b7f7e558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:22.916744 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9ae211ed-641e-4c22-aeac-bb07b7f7e558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.193632 Apr 12 15:14:22.917511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 650/1275] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:22 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:23.935733 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6a4e7277-5f42-40d1-9cc9-eab31881fc03 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:23.936346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6a4e7277-5f42-40d1-9cc9-eab31881fc03 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:23.943985 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a4e7277-5f42-40d1-9cc9-eab31881fc03 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:23.944504 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a4e7277-5f42-40d1-9cc9-eab31881fc03 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:23.945349 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a4e7277-5f42-40d1-9cc9-eab31881fc03 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:23.945882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a4e7277-5f42-40d1-9cc9-eab31881fc03 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:24.104555 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6a4e7277-5f42-40d1-9cc9-eab31881fc03 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:24.116041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6a4e7277-5f42-40d1-9cc9-eab31881fc03 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.183756 Apr 12 15:14:24.121666 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 626/1276] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:23 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:25.135108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-08e2b202-d8ac-444e-bcf7-4c706fe75c02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:25.135900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-08e2b202-d8ac-444e-bcf7-4c706fe75c02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:25.150421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08e2b202-d8ac-444e-bcf7-4c706fe75c02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:25.151342 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08e2b202-d8ac-444e-bcf7-4c706fe75c02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:25.152425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08e2b202-d8ac-444e-bcf7-4c706fe75c02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:25.153103 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08e2b202-d8ac-444e-bcf7-4c706fe75c02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:25.322957 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-08e2b202-d8ac-444e-bcf7-4c706fe75c02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:25.332724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-08e2b202-d8ac-444e-bcf7-4c706fe75c02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.202506 Apr 12 15:14:25.333691 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 651/1277] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:25 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:25.616791 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:14:25.616958 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:14:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:14:26.357147 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c433a6ab-42e2-4cce-8e24-e7eddabc2d1b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:26.357861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c433a6ab-42e2-4cce-8e24-e7eddabc2d1b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:26.372340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c433a6ab-42e2-4cce-8e24-e7eddabc2d1b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:26.372805 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c433a6ab-42e2-4cce-8e24-e7eddabc2d1b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:26.373608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c433a6ab-42e2-4cce-8e24-e7eddabc2d1b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:26.374960 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c433a6ab-42e2-4cce-8e24-e7eddabc2d1b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:26.592187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c433a6ab-42e2-4cce-8e24-e7eddabc2d1b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:26.617676 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c433a6ab-42e2-4cce-8e24-e7eddabc2d1b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.270458 Apr 12 15:14:26.619248 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 627/1278] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:26 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:27.636708 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4b93f02a-b4e1-4dd0-9b52-715414533ff0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:27.637342 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4b93f02a-b4e1-4dd0-9b52-715414533ff0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:27.644028 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4b93f02a-b4e1-4dd0-9b52-715414533ff0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:27.644472 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4b93f02a-b4e1-4dd0-9b52-715414533ff0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:27.649925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4b93f02a-b4e1-4dd0-9b52-715414533ff0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:27.650705 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4b93f02a-b4e1-4dd0-9b52-715414533ff0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:27.816067 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4b93f02a-b4e1-4dd0-9b52-715414533ff0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:27.824884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4b93f02a-b4e1-4dd0-9b52-715414533ff0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.193262 Apr 12 15:14:27.825476 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 652/1279] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:27 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:28.843102 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5c9bb416-9595-4e6a-ac8f-4634c0263b93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:28.843723 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5c9bb416-9595-4e6a-ac8f-4634c0263b93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:28.850397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5c9bb416-9595-4e6a-ac8f-4634c0263b93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:28.851179 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5c9bb416-9595-4e6a-ac8f-4634c0263b93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:28.851961 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5c9bb416-9595-4e6a-ac8f-4634c0263b93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:28.853262 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5c9bb416-9595-4e6a-ac8f-4634c0263b93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:29.014193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5c9bb416-9595-4e6a-ac8f-4634c0263b93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:29.022752 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5c9bb416-9595-4e6a-ac8f-4634c0263b93 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.183624 Apr 12 15:14:29.024074 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 628/1280] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:28 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:30.042372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6c19b421-ff5e-4d2e-b7ad-642b05c976c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:30.044054 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6c19b421-ff5e-4d2e-b7ad-642b05c976c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:30.051566 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c19b421-ff5e-4d2e-b7ad-642b05c976c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:30.052372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c19b421-ff5e-4d2e-b7ad-642b05c976c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:30.053560 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c19b421-ff5e-4d2e-b7ad-642b05c976c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:30.054447 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c19b421-ff5e-4d2e-b7ad-642b05c976c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:30.225599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6c19b421-ff5e-4d2e-b7ad-642b05c976c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:30.236722 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6c19b421-ff5e-4d2e-b7ad-642b05c976c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.200188 Apr 12 15:14:30.248402 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 653/1281] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:30 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:31.256309 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-28d39d77-a758-4180-b904-15023ce6550e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:31.256886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-28d39d77-a758-4180-b904-15023ce6550e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:31.263988 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-28d39d77-a758-4180-b904-15023ce6550e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:31.264438 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-28d39d77-a758-4180-b904-15023ce6550e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:31.265224 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-28d39d77-a758-4180-b904-15023ce6550e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:31.265661 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-28d39d77-a758-4180-b904-15023ce6550e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:31.420690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-28d39d77-a758-4180-b904-15023ce6550e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:31.431042 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-28d39d77-a758-4180-b904-15023ce6550e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.177955 Apr 12 15:14:31.441257 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 629/1282] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:31 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:32.449056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bb56904e-fa3d-4d37-a9b9-24d078dbd00f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:32.450714 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bb56904e-fa3d-4d37-a9b9-24d078dbd00f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:32.457999 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb56904e-fa3d-4d37-a9b9-24d078dbd00f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:32.458804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb56904e-fa3d-4d37-a9b9-24d078dbd00f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:32.459655 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb56904e-fa3d-4d37-a9b9-24d078dbd00f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:32.460173 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb56904e-fa3d-4d37-a9b9-24d078dbd00f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:32.616419 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bb56904e-fa3d-4d37-a9b9-24d078dbd00f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:32.629882 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bb56904e-fa3d-4d37-a9b9-24d078dbd00f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.185234 Apr 12 15:14:32.630457 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 654/1283] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:32 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:33.649976 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-db9fab2e-3452-4d14-8c20-a7e3dd5923e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:33.651586 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-db9fab2e-3452-4d14-8c20-a7e3dd5923e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:33.659973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db9fab2e-3452-4d14-8c20-a7e3dd5923e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:33.660725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db9fab2e-3452-4d14-8c20-a7e3dd5923e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:33.661868 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db9fab2e-3452-4d14-8c20-a7e3dd5923e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:33.662445 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-db9fab2e-3452-4d14-8c20-a7e3dd5923e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:33.859016 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-db9fab2e-3452-4d14-8c20-a7e3dd5923e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:33.874271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-db9fab2e-3452-4d14-8c20-a7e3dd5923e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.228997 Apr 12 15:14:33.875464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 630/1284] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:33 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:34.901156 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-03b93b73-6dd8-46fb-aa06-90b24f55c622 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:34.901772 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-03b93b73-6dd8-46fb-aa06-90b24f55c622 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:34.908265 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03b93b73-6dd8-46fb-aa06-90b24f55c622 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:34.908808 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03b93b73-6dd8-46fb-aa06-90b24f55c622 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:34.909453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03b93b73-6dd8-46fb-aa06-90b24f55c622 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:34.909909 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03b93b73-6dd8-46fb-aa06-90b24f55c622 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:35.044042 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-03b93b73-6dd8-46fb-aa06-90b24f55c622 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:35.051960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-03b93b73-6dd8-46fb-aa06-90b24f55c622 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.155457 Apr 12 15:14:35.052513 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 655/1285] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:34 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:35.145783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8b1b42cd-d66f-40c4-b8a9-b3cf1e2d95d5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Action: 'create', calling method: .version_select at 0x7fbd607fc430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1638317891"}} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:14:35.160847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-8b1b42cd-d66f-40c4-b8a9-b3cf1e2d95d5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Getting quotas for project 02c6845b3d9d43428aee79de0f571835. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:14:35.164827 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-8b1b42cd-d66f-40c4-b8a9-b3cf1e2d95d5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Getting quotas for user 4ab4730f1d2140ca8ccc2d5227e7a97f and project 02c6845b3d9d43428aee79de0f571835. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:14:35.484481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-8b1b42cd-d66f-40c4-b8a9-b3cf1e2d95d5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Getting quotas for project 02c6845b3d9d43428aee79de0f571835. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:14:35.488089 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.quota [None req-8b1b42cd-d66f-40c4-b8a9-b3cf1e2d95d5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Getting quotas for user 4ab4730f1d2140ca8ccc2d5227e7a97f and project 02c6845b3d9d43428aee79de0f571835. Resources: {'key_pairs'} {{(pid=124198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:14:35.502529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8b1b42cd-d66f-40c4-b8a9-b3cf1e2d95d5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.360471 Apr 12 15:14:35.503145 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 631/1286] 10.222.0.64 () {60 vars in 1157 bytes} [Tue Apr 12 15:14:35 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:35.562752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1616138860", "imageRef": "38bf09b2-71c9-4547-a673-3981610718bf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1638317891", "networks": [{"uuid": "00c64e69-a8f5-4a03-947d-7bd730bbad16"}]}} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:14:35.613081 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.network.neutron [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] validate_networks() for [('00c64e69-a8f5-4a03-947d-7bd730bbad16', None, None, None, None, None)] {{(pid=124199) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 15:14:36.046535 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Flavor limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:14:36.047058 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Image limits 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:14:36.047402 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Flavor pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:14:36.047801 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Image pref 0:0:0 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:14:36.048205 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.virt.hardware [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:14:36.058071 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:36.058509 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:36.059304 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:36.059732 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:36.068168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-51899c98-f306-468e-aec7-bc4eb566bbe4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:36.068780 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-51899c98-f306-468e-aec7-bc4eb566bbe4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:36.075161 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-51899c98-f306-468e-aec7-bc4eb566bbe4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:36.075606 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-51899c98-f306-468e-aec7-bc4eb566bbe4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:36.076376 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-51899c98-f306-468e-aec7-bc4eb566bbe4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:36.076808 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-51899c98-f306-468e-aec7-bc4eb566bbe4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:36.088763 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Getting quotas for project 02c6845b3d9d43428aee79de0f571835. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:14:36.092953 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.quota [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Getting quotas for user 4ab4730f1d2140ca8ccc2d5227e7a97f and project 02c6845b3d9d43428aee79de0f571835. Resources: {'ram', 'cores', 'instances'} {{(pid=124199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:14:36.105487 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Going to run 1 instances... {{(pid=124199) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 15:14:36.108061 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38bf09b2-71c9-4547-a673-3981610718bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 15:14:36.216525 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-51899c98-f306-468e-aec7-bc4eb566bbe4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:36.224465 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-51899c98-f306-468e-aec7-bc4eb566bbe4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.160147 Apr 12 15:14:36.225034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 632/1287] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:36 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:36.251123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-08c7288b-80ff-4862-86dc-002401444129 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692245 Apr 12 15:14:36.256654 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 656/1288] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Apr 12 15:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 15:14:36.266243 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7b41197d-948c-40fc-8ca7-f57b3facf2a5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:36.266993 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7b41197d-948c-40fc-8ca7-f57b3facf2a5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:36.319024 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7b41197d-948c-40fc-8ca7-f57b3facf2a5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:36.335661 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7b41197d-948c-40fc-8ca7-f57b3facf2a5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1259 microversion: 2.1 time: 0.073277 Apr 12 15:14:36.336344 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 633/1289] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:36 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:37.241956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-121d7c1d-d370-49a2-9e4d-4e235b74c192 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:37.242725 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-121d7c1d-d370-49a2-9e4d-4e235b74c192 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:37.251588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-121d7c1d-d370-49a2-9e4d-4e235b74c192 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:37.252043 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-121d7c1d-d370-49a2-9e4d-4e235b74c192 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:37.252825 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-121d7c1d-d370-49a2-9e4d-4e235b74c192 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:37.253259 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-121d7c1d-d370-49a2-9e4d-4e235b74c192 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:37.363438 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9601519b-80c6-48f0-b9dc-dd2489a54b1c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:37.363438 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9601519b-80c6-48f0-b9dc-dd2489a54b1c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:37.404029 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-121d7c1d-d370-49a2-9e4d-4e235b74c192 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:37.412635 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-121d7c1d-d370-49a2-9e4d-4e235b74c192 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.175044 Apr 12 15:14:37.413367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 657/1290] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:37 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:37.420815 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9601519b-80c6-48f0-b9dc-dd2489a54b1c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:37.433098 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9601519b-80c6-48f0-b9dc-dd2489a54b1c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1259 microversion: 2.1 time: 0.074402 Apr 12 15:14:37.439069 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 634/1291] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:37 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:38.430975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-514f3409-3d40-486c-9fcf-616573172505 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:38.431585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-514f3409-3d40-486c-9fcf-616573172505 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:38.438336 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-514f3409-3d40-486c-9fcf-616573172505 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:38.438793 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-514f3409-3d40-486c-9fcf-616573172505 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:38.439571 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-514f3409-3d40-486c-9fcf-616573172505 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:38.440009 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-514f3409-3d40-486c-9fcf-616573172505 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:38.455354 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6ee693f5-a83e-4eb6-b7d0-a7d1cd2f35e7 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:38.455949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6ee693f5-a83e-4eb6-b7d0-a7d1cd2f35e7 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:38.466125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6ee693f5-a83e-4eb6-b7d0-a7d1cd2f35e7 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:38.466746 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6ee693f5-a83e-4eb6-b7d0-a7d1cd2f35e7 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:38.467730 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6ee693f5-a83e-4eb6-b7d0-a7d1cd2f35e7 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:38.468160 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6ee693f5-a83e-4eb6-b7d0-a7d1cd2f35e7 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:38.551837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6ee693f5-a83e-4eb6-b7d0-a7d1cd2f35e7 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:38.559560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6ee693f5-a83e-4eb6-b7d0-a7d1cd2f35e7 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1311 microversion: 2.1 time: 0.108175 Apr 12 15:14:38.560149 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 635/1292] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:38 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:38.620064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-514f3409-3d40-486c-9fcf-616573172505 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:38.629423 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-514f3409-3d40-486c-9fcf-616573172505 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.202466 Apr 12 15:14:38.630368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 658/1293] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:38 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:39.587195 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-20394599-1099-4901-8eec-81a36bd568f5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:39.588529 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-20394599-1099-4901-8eec-81a36bd568f5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:39.598818 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20394599-1099-4901-8eec-81a36bd568f5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:39.599982 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20394599-1099-4901-8eec-81a36bd568f5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:39.602300 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20394599-1099-4901-8eec-81a36bd568f5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:39.603746 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-20394599-1099-4901-8eec-81a36bd568f5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:39.647807 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1c415f15-ca71-418d-9cbb-4d4e1ceaee89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:39.650367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1c415f15-ca71-418d-9cbb-4d4e1ceaee89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:39.663534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c415f15-ca71-418d-9cbb-4d4e1ceaee89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:39.665034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c415f15-ca71-418d-9cbb-4d4e1ceaee89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:39.667224 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c415f15-ca71-418d-9cbb-4d4e1ceaee89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:39.668956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c415f15-ca71-418d-9cbb-4d4e1ceaee89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:39.703972 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:14:39.704242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:14:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f (ip 10.222.0.64) !!! Apr 12 15:14:39.831971 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-20394599-1099-4901-8eec-81a36bd568f5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:39.849040 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-20394599-1099-4901-8eec-81a36bd568f5 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.267828 Apr 12 15:14:39.853882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 636/1294] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:39 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:39.997252 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1c415f15-ca71-418d-9cbb-4d4e1ceaee89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:40.012379 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1c415f15-ca71-418d-9cbb-4d4e1ceaee89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.367579 Apr 12 15:14:40.028392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 659/1295] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:39 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:40.875726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-874ce4cf-b8ac-4f7e-b536-73608fb7ea77 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:40.876255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-874ce4cf-b8ac-4f7e-b536-73608fb7ea77 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:40.891064 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-874ce4cf-b8ac-4f7e-b536-73608fb7ea77 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:40.891522 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-874ce4cf-b8ac-4f7e-b536-73608fb7ea77 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:40.892324 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-874ce4cf-b8ac-4f7e-b536-73608fb7ea77 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:40.892766 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-874ce4cf-b8ac-4f7e-b536-73608fb7ea77 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:40.932125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-082785c5-5577-4a6a-96d1-c1719a891357 req-f2eed18d-fc2b-474a-ac68-eef9d21384af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40087dd0-4e35-4fa7-a289-68d4db17ee5f", "tag": "6f814532-934c-4416-b3a5-eb58a7905405"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:14:40.942114 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-082785c5-5577-4a6a-96d1-c1719a891357 req-f2eed18d-fc2b-474a-ac68-eef9d21384af service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:40.943728 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-082785c5-5577-4a6a-96d1-c1719a891357 req-f2eed18d-fc2b-474a-ac68-eef9d21384af service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:40.958112 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-082785c5-5577-4a6a-96d1-c1719a891357 req-f2eed18d-fc2b-474a-ac68-eef9d21384af service nova] Creating event network-changed:6f814532-934c-4416-b3a5-eb58a7905405 for instance 40087dd0-4e35-4fa7-a289-68d4db17ee5f on hv-cinder-83752 Apr 12 15:14:40.964304 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: ERROR oslo.messaging._drivers.impl_rabbit [req-082785c5-5577-4a6a-96d1-c1719a891357 req-f2eed18d-fc2b-474a-ac68-eef9d21384af service nova] [759d971b-41ca-478c-87f7-a03d6117574e] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 15:14:41.077886 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-874ce4cf-b8ac-4f7e-b536-73608fb7ea77 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:41.086908 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-874ce4cf-b8ac-4f7e-b536-73608fb7ea77 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.214807 Apr 12 15:14:41.088036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 660/1296] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:40 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:41.092909 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cfab082e-6625-4d67-9068-e34a417e3ccd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:41.106778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cfab082e-6625-4d67-9068-e34a417e3ccd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:41.117436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfab082e-6625-4d67-9068-e34a417e3ccd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:41.118147 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfab082e-6625-4d67-9068-e34a417e3ccd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:41.119015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfab082e-6625-4d67-9068-e34a417e3ccd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:41.119512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfab082e-6625-4d67-9068-e34a417e3ccd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:41.274958 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cfab082e-6625-4d67-9068-e34a417e3ccd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:41.291225 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cfab082e-6625-4d67-9068-e34a417e3ccd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.202073 Apr 12 15:14:41.292021 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 661/1297] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:41 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:41.976429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [req-082785c5-5577-4a6a-96d1-c1719a891357 req-f2eed18d-fc2b-474a-ac68-eef9d21384af service nova] [759d971b-41ca-478c-87f7-a03d6117574e] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 35880. Apr 12 15:14:41.981202 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-082785c5-5577-4a6a-96d1-c1719a891357 req-f2eed18d-fc2b-474a-ac68-eef9d21384af service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.162623 Apr 12 15:14:41.981840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 637/1298] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:14:42.107931 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bfb85e6c-a212-4295-a49c-7f7d931d007b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:42.108539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bfb85e6c-a212-4295-a49c-7f7d931d007b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:42.114962 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bfb85e6c-a212-4295-a49c-7f7d931d007b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:42.115412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bfb85e6c-a212-4295-a49c-7f7d931d007b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:42.116184 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bfb85e6c-a212-4295-a49c-7f7d931d007b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:42.116618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bfb85e6c-a212-4295-a49c-7f7d931d007b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:42.271492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bfb85e6c-a212-4295-a49c-7f7d931d007b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:42.284845 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bfb85e6c-a212-4295-a49c-7f7d931d007b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.180844 Apr 12 15:14:42.285732 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 662/1299] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:42 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:42.310056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-58e086cc-f3b9-4ba1-a4af-f5fc52e3c774 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:42.310754 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-58e086cc-f3b9-4ba1-a4af-f5fc52e3c774 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:42.317107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-58e086cc-f3b9-4ba1-a4af-f5fc52e3c774 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:42.317712 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-58e086cc-f3b9-4ba1-a4af-f5fc52e3c774 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:42.318723 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-58e086cc-f3b9-4ba1-a4af-f5fc52e3c774 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:42.319337 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-58e086cc-f3b9-4ba1-a4af-f5fc52e3c774 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:42.457809 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-58e086cc-f3b9-4ba1-a4af-f5fc52e3c774 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:42.466303 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-58e086cc-f3b9-4ba1-a4af-f5fc52e3c774 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.160498 Apr 12 15:14:42.467071 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 638/1300] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:42 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:43.304206 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-03ddca15-8be6-481f-aeb0-911f2cdcbd7f tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:43.306053 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-03ddca15-8be6-481f-aeb0-911f2cdcbd7f tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:43.315792 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03ddca15-8be6-481f-aeb0-911f2cdcbd7f tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:43.316627 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03ddca15-8be6-481f-aeb0-911f2cdcbd7f tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:43.317227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03ddca15-8be6-481f-aeb0-911f2cdcbd7f tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:43.318956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03ddca15-8be6-481f-aeb0-911f2cdcbd7f tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:43.455526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-03ddca15-8be6-481f-aeb0-911f2cdcbd7f tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:43.463887 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-03ddca15-8be6-481f-aeb0-911f2cdcbd7f tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.164176 Apr 12 15:14:43.464470 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 663/1301] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:43 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:43.483372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4f7d0bd7-2d98-42d1-9449-7e2ed7cea9f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:43.483984 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4f7d0bd7-2d98-42d1-9449-7e2ed7cea9f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:43.490653 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4f7d0bd7-2d98-42d1-9449-7e2ed7cea9f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:43.491459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4f7d0bd7-2d98-42d1-9449-7e2ed7cea9f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:43.493090 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4f7d0bd7-2d98-42d1-9449-7e2ed7cea9f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:43.493810 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4f7d0bd7-2d98-42d1-9449-7e2ed7cea9f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:43.670588 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4f7d0bd7-2d98-42d1-9449-7e2ed7cea9f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:43.680538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4f7d0bd7-2d98-42d1-9449-7e2ed7cea9f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.200900 Apr 12 15:14:43.681326 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 639/1302] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:43 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:44.483321 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ef5f6856-6379-4db1-be71-f6058303a9dd tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:44.483915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ef5f6856-6379-4db1-be71-f6058303a9dd tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:44.491268 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef5f6856-6379-4db1-be71-f6058303a9dd tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:44.491869 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef5f6856-6379-4db1-be71-f6058303a9dd tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:44.492689 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef5f6856-6379-4db1-be71-f6058303a9dd tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:44.493180 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef5f6856-6379-4db1-be71-f6058303a9dd tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:44.632155 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ef5f6856-6379-4db1-be71-f6058303a9dd tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:44.641496 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ef5f6856-6379-4db1-be71-f6058303a9dd tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.161919 Apr 12 15:14:44.642339 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 664/1303] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:44 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:44.706170 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-02d64332-4738-406a-a5ba-56abc14339c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:44.706805 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-02d64332-4738-406a-a5ba-56abc14339c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:44.713251 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-02d64332-4738-406a-a5ba-56abc14339c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:44.713740 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-02d64332-4738-406a-a5ba-56abc14339c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:44.714528 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-02d64332-4738-406a-a5ba-56abc14339c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:44.714976 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-02d64332-4738-406a-a5ba-56abc14339c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:44.858037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-02d64332-4738-406a-a5ba-56abc14339c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:44.866100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-02d64332-4738-406a-a5ba-56abc14339c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.163751 Apr 12 15:14:44.876331 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 640/1304] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:44 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:45.663073 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6b520938-18db-403a-b218-c258a655346c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:45.665171 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6b520938-18db-403a-b218-c258a655346c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:45.673168 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b520938-18db-403a-b218-c258a655346c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:45.674197 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b520938-18db-403a-b218-c258a655346c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:45.675560 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b520938-18db-403a-b218-c258a655346c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:45.676380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b520938-18db-403a-b218-c258a655346c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:45.838332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6b520938-18db-403a-b218-c258a655346c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:45.851123 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6b520938-18db-403a-b218-c258a655346c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.193217 Apr 12 15:14:45.852169 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 665/1305] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:45 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:45.885387 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-537d7645-21cb-4347-866d-62d570b8567f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:45.886031 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-537d7645-21cb-4347-866d-62d570b8567f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:45.892632 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-537d7645-21cb-4347-866d-62d570b8567f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:45.893442 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-537d7645-21cb-4347-866d-62d570b8567f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:45.894654 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-537d7645-21cb-4347-866d-62d570b8567f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:45.895154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-537d7645-21cb-4347-866d-62d570b8567f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:46.069481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-537d7645-21cb-4347-866d-62d570b8567f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:46.082258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-537d7645-21cb-4347-866d-62d570b8567f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.200956 Apr 12 15:14:46.083275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 641/1306] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:45 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:46.869873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e8be85c0-04c7-40c9-9067-32fcc8be73b2 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:46.870525 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e8be85c0-04c7-40c9-9067-32fcc8be73b2 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:46.877251 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e8be85c0-04c7-40c9-9067-32fcc8be73b2 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:46.883237 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e8be85c0-04c7-40c9-9067-32fcc8be73b2 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:46.884471 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e8be85c0-04c7-40c9-9067-32fcc8be73b2 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:46.884902 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e8be85c0-04c7-40c9-9067-32fcc8be73b2 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:47.027720 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e8be85c0-04c7-40c9-9067-32fcc8be73b2 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:47.035519 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e8be85c0-04c7-40c9-9067-32fcc8be73b2 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.170948 Apr 12 15:14:47.036091 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 666/1307] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:46 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:47.101972 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5a005a08-92f3-4096-a97d-239685067155 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:47.102564 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5a005a08-92f3-4096-a97d-239685067155 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:47.108987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5a005a08-92f3-4096-a97d-239685067155 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:47.109429 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5a005a08-92f3-4096-a97d-239685067155 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:47.110330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5a005a08-92f3-4096-a97d-239685067155 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:47.110829 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5a005a08-92f3-4096-a97d-239685067155 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:47.241953 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5a005a08-92f3-4096-a97d-239685067155 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:47.250340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5a005a08-92f3-4096-a97d-239685067155 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152706 Apr 12 15:14:47.255645 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 642/1308] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:47 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:48.052585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c6687246-8139-4c6e-a319-0174da802a03 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:48.053226 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c6687246-8139-4c6e-a319-0174da802a03 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:48.060492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6687246-8139-4c6e-a319-0174da802a03 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:48.060938 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6687246-8139-4c6e-a319-0174da802a03 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:48.061727 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6687246-8139-4c6e-a319-0174da802a03 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:48.062154 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6687246-8139-4c6e-a319-0174da802a03 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:48.192609 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c6687246-8139-4c6e-a319-0174da802a03 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:48.200086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c6687246-8139-4c6e-a319-0174da802a03 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.151638 Apr 12 15:14:48.200657 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 667/1309] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:48 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:48.267823 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a313812c-8b7f-49ec-8565-8fed83544cea tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:48.268485 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a313812c-8b7f-49ec-8565-8fed83544cea tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:48.275351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a313812c-8b7f-49ec-8565-8fed83544cea tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:48.275790 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a313812c-8b7f-49ec-8565-8fed83544cea tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:48.276546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a313812c-8b7f-49ec-8565-8fed83544cea tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:48.276973 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a313812c-8b7f-49ec-8565-8fed83544cea tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:48.403039 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a313812c-8b7f-49ec-8565-8fed83544cea tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:48.410692 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a313812c-8b7f-49ec-8565-8fed83544cea tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.146732 Apr 12 15:14:48.411256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 643/1310] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:48 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:49.217990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-77884f9d-7cb3-4037-bfbb-1454f9697346 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:49.218633 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-77884f9d-7cb3-4037-bfbb-1454f9697346 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:49.225109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77884f9d-7cb3-4037-bfbb-1454f9697346 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:49.225550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77884f9d-7cb3-4037-bfbb-1454f9697346 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:49.226441 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77884f9d-7cb3-4037-bfbb-1454f9697346 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:49.227408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-77884f9d-7cb3-4037-bfbb-1454f9697346 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:49.358314 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-77884f9d-7cb3-4037-bfbb-1454f9697346 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:49.365536 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-77884f9d-7cb3-4037-bfbb-1454f9697346 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.151352 Apr 12 15:14:49.366143 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 668/1311] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:49 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:49.428411 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2f4b3347-6619-4226-a295-b6cf8ebec86b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:49.429010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2f4b3347-6619-4226-a295-b6cf8ebec86b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:49.436107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f4b3347-6619-4226-a295-b6cf8ebec86b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:49.436555 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f4b3347-6619-4226-a295-b6cf8ebec86b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:49.437328 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f4b3347-6619-4226-a295-b6cf8ebec86b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:49.438009 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f4b3347-6619-4226-a295-b6cf8ebec86b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:49.566914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2f4b3347-6619-4226-a295-b6cf8ebec86b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:49.575886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2f4b3347-6619-4226-a295-b6cf8ebec86b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.151306 Apr 12 15:14:49.576599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 644/1312] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:49 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:50.383768 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c4a839d8-4083-4134-99b7-58b1fcc26c80 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:50.384455 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c4a839d8-4083-4134-99b7-58b1fcc26c80 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:50.390432 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4a839d8-4083-4134-99b7-58b1fcc26c80 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:50.390873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4a839d8-4083-4134-99b7-58b1fcc26c80 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:50.391622 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4a839d8-4083-4134-99b7-58b1fcc26c80 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:50.392045 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4a839d8-4083-4134-99b7-58b1fcc26c80 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:50.514753 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c4a839d8-4083-4134-99b7-58b1fcc26c80 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:50.522246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c4a839d8-4083-4134-99b7-58b1fcc26c80 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.143584 Apr 12 15:14:50.522801 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 669/1313] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:50 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:50.596809 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-cbc31000-7d1e-4273-818b-d00a269cd58f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:50.597442 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cbc31000-7d1e-4273-818b-d00a269cd58f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:50.603549 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cbc31000-7d1e-4273-818b-d00a269cd58f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:50.603997 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cbc31000-7d1e-4273-818b-d00a269cd58f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:50.604761 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cbc31000-7d1e-4273-818b-d00a269cd58f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:50.605194 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cbc31000-7d1e-4273-818b-d00a269cd58f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:50.732508 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-cbc31000-7d1e-4273-818b-d00a269cd58f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:50.740155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-cbc31000-7d1e-4273-818b-d00a269cd58f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.147174 Apr 12 15:14:50.740726 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 645/1314] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:50 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:51.539828 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8bbe01d0-b6b2-4804-b38c-421c00eedd81 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:51.540447 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8bbe01d0-b6b2-4804-b38c-421c00eedd81 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:51.546989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bbe01d0-b6b2-4804-b38c-421c00eedd81 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:51.547433 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bbe01d0-b6b2-4804-b38c-421c00eedd81 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:51.548448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bbe01d0-b6b2-4804-b38c-421c00eedd81 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:51.549062 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bbe01d0-b6b2-4804-b38c-421c00eedd81 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:51.594899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [req-2ecb52f0-66da-45d5-9287-3dcb6b63a241 req-a85e10c7-700c-4249-be3e-0f796f973f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40087dd0-4e35-4fa7-a289-68d4db17ee5f", "name": "network-vif-plugged", "status": "completed", "tag": "6f814532-934c-4416-b3a5-eb58a7905405"}]} {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:14:51.603651 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2ecb52f0-66da-45d5-9287-3dcb6b63a241 req-a85e10c7-700c-4249-be3e-0f796f973f53 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:51.604083 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [req-2ecb52f0-66da-45d5-9287-3dcb6b63a241 req-a85e10c7-700c-4249-be3e-0f796f973f53 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:51.618886 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.compute.server_external_events [req-2ecb52f0-66da-45d5-9287-3dcb6b63a241 req-a85e10c7-700c-4249-be3e-0f796f973f53 service nova] Creating event network-vif-plugged:6f814532-934c-4416-b3a5-eb58a7905405 for instance 40087dd0-4e35-4fa7-a289-68d4db17ee5f on hv-cinder-83752 Apr 12 15:14:51.624424 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [req-2ecb52f0-66da-45d5-9287-3dcb6b63a241 req-a85e10c7-700c-4249-be3e-0f796f973f53 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099080 Apr 12 15:14:51.625021 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 670/1315] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 15:14:51.701658 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8bbe01d0-b6b2-4804-b38c-421c00eedd81 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:51.709166 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8bbe01d0-b6b2-4804-b38c-421c00eedd81 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.173508 Apr 12 15:14:51.709771 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 646/1316] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:51 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:51.758074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-60a5593a-cabb-4eff-8ed9-e9a534688d4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:51.758776 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-60a5593a-cabb-4eff-8ed9-e9a534688d4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:51.765032 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60a5593a-cabb-4eff-8ed9-e9a534688d4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:51.765480 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60a5593a-cabb-4eff-8ed9-e9a534688d4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:51.766280 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60a5593a-cabb-4eff-8ed9-e9a534688d4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:51.766725 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60a5593a-cabb-4eff-8ed9-e9a534688d4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:51.900041 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-60a5593a-cabb-4eff-8ed9-e9a534688d4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:51.908450 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-60a5593a-cabb-4eff-8ed9-e9a534688d4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.155149 Apr 12 15:14:51.909019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 671/1317] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:51 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:52.725208 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d5bacc81-4dfe-4743-b750-8f233dab188b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:52.725857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d5bacc81-4dfe-4743-b750-8f233dab188b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:52.732426 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5bacc81-4dfe-4743-b750-8f233dab188b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:52.732874 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5bacc81-4dfe-4743-b750-8f233dab188b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:52.733724 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5bacc81-4dfe-4743-b750-8f233dab188b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:52.734161 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d5bacc81-4dfe-4743-b750-8f233dab188b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:52.871512 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d5bacc81-4dfe-4743-b750-8f233dab188b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:52.878799 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d5bacc81-4dfe-4743-b750-8f233dab188b tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1359 microversion: 2.1 time: 0.157310 Apr 12 15:14:52.879371 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 647/1318] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:52 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:52.925592 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9b20d594-2c5b-4024-b550-d0fca128c5d5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:52.926217 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9b20d594-2c5b-4024-b550-d0fca128c5d5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:52.933747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b20d594-2c5b-4024-b550-d0fca128c5d5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:52.934192 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b20d594-2c5b-4024-b550-d0fca128c5d5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:52.934969 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b20d594-2c5b-4024-b550-d0fca128c5d5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:52.935392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b20d594-2c5b-4024-b550-d0fca128c5d5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:53.064986 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9b20d594-2c5b-4024-b550-d0fca128c5d5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:53.074329 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9b20d594-2c5b-4024-b550-d0fca128c5d5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152050 Apr 12 15:14:53.074555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 672/1319] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:52 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:53.896087 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0a351c65-87e5-4f5d-9049-ffd1044f6ce1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:53.896705 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0a351c65-87e5-4f5d-9049-ffd1044f6ce1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:53.904047 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a351c65-87e5-4f5d-9049-ffd1044f6ce1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:53.904499 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a351c65-87e5-4f5d-9049-ffd1044f6ce1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:53.905270 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a351c65-87e5-4f5d-9049-ffd1044f6ce1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:53.905741 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a351c65-87e5-4f5d-9049-ffd1044f6ce1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:54.043398 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0a351c65-87e5-4f5d-9049-ffd1044f6ce1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:54.051182 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0a351c65-87e5-4f5d-9049-ffd1044f6ce1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1550 microversion: 2.1 time: 0.158840 Apr 12 15:14:54.051781 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 648/1320] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:53 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:54.071885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8e435411-01db-42aa-adf7-5ca0540f79bf tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:54.071885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8e435411-01db-42aa-adf7-5ca0540f79bf tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:54.076916 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e435411-01db-42aa-adf7-5ca0540f79bf tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:54.077359 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e435411-01db-42aa-adf7-5ca0540f79bf tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:54.078201 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e435411-01db-42aa-adf7-5ca0540f79bf tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:54.078775 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8e435411-01db-42aa-adf7-5ca0540f79bf tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:54.090959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d691732a-36e0-4017-be1a-ec8efd99165b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:54.091577 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d691732a-36e0-4017-be1a-ec8efd99165b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:54.097919 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d691732a-36e0-4017-be1a-ec8efd99165b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:54.098376 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d691732a-36e0-4017-be1a-ec8efd99165b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:54.099165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d691732a-36e0-4017-be1a-ec8efd99165b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:54.099606 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d691732a-36e0-4017-be1a-ec8efd99165b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:54.277969 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8e435411-01db-42aa-adf7-5ca0540f79bf tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:54.281190 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d691732a-36e0-4017-be1a-ec8efd99165b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:54.286155 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8e435411-01db-42aa-adf7-5ca0540f79bf tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1550 microversion: 2.1 time: 0.221123 Apr 12 15:14:54.286750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 673/1321] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:54 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1550 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:54.292365 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d691732a-36e0-4017-be1a-ec8efd99165b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.205325 Apr 12 15:14:54.293230 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 649/1322] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:54 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:54.302990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-66d0ac1a-5f6c-43c9-93dd-1c7353a08db1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:54.307923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-66d0ac1a-5f6c-43c9-93dd-1c7353a08db1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:54.308688 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-66d0ac1a-5f6c-43c9-93dd-1c7353a08db1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Searching by: {'deleted': False, 'project_id': '02c6845b3d9d43428aee79de0f571835'} {{(pid=124199) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 12 15:14:54.315482 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66d0ac1a-5f6c-43c9-93dd-1c7353a08db1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:54.315925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66d0ac1a-5f6c-43c9-93dd-1c7353a08db1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:54.316790 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66d0ac1a-5f6c-43c9-93dd-1c7353a08db1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:54.317216 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-66d0ac1a-5f6c-43c9-93dd-1c7353a08db1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:54.410236 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.multi_cell_list [None req-66d0ac1a-5f6c-43c9-93dd-1c7353a08db1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124199) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 15:14:54.515309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-66d0ac1a-5f6c-43c9-93dd-1c7353a08db1 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215958 Apr 12 15:14:54.515803 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 674/1323] 10.222.0.64 () {58 vars in 1124 bytes} [Tue Apr 12 15:14:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:14:54.526963 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-da229d55-f012-49f0-8984-0e06548416a3 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:54.527637 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-da229d55-f012-49f0-8984-0e06548416a3 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:54.533774 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da229d55-f012-49f0-8984-0e06548416a3 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:54.534223 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da229d55-f012-49f0-8984-0e06548416a3 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:54.534985 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da229d55-f012-49f0-8984-0e06548416a3 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:54.535417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-da229d55-f012-49f0-8984-0e06548416a3 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:54.660939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-da229d55-f012-49f0-8984-0e06548416a3 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:54.669083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-da229d55-f012-49f0-8984-0e06548416a3 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1550 microversion: 2.1 time: 0.146822 Apr 12 15:14:54.669670 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 650/1324] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:54 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1550 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:55.313840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-da052d70-cc51-4213-bbfb-49bb8054c9e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:55.313840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-da052d70-cc51-4213-bbfb-49bb8054c9e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:55.318706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da052d70-cc51-4213-bbfb-49bb8054c9e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:55.319161 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da052d70-cc51-4213-bbfb-49bb8054c9e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:55.320153 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da052d70-cc51-4213-bbfb-49bb8054c9e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:55.320710 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-da052d70-cc51-4213-bbfb-49bb8054c9e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:55.456827 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-da052d70-cc51-4213-bbfb-49bb8054c9e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:55.465602 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-da052d70-cc51-4213-bbfb-49bb8054c9e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.158307 Apr 12 15:14:55.466198 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 675/1325] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:55 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:56.489305 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2ec6a30f-1e1c-4ca9-b544-98fd57cc6dc3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:56.498738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2ec6a30f-1e1c-4ca9-b544-98fd57cc6dc3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:56.500963 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2ec6a30f-1e1c-4ca9-b544-98fd57cc6dc3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:56.501809 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2ec6a30f-1e1c-4ca9-b544-98fd57cc6dc3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:56.503223 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2ec6a30f-1e1c-4ca9-b544-98fd57cc6dc3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:56.503985 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2ec6a30f-1e1c-4ca9-b544-98fd57cc6dc3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:56.650004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2ec6a30f-1e1c-4ca9-b544-98fd57cc6dc3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:56.657956 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2ec6a30f-1e1c-4ca9-b544-98fd57cc6dc3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.176849 Apr 12 15:14:56.658534 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 651/1326] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:56 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:14:57.676245 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2555d2a7-9415-49e1-bb3b-11f41d6991cb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:57.676837 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2555d2a7-9415-49e1-bb3b-11f41d6991cb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:57.684945 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2555d2a7-9415-49e1-bb3b-11f41d6991cb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:57.685384 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2555d2a7-9415-49e1-bb3b-11f41d6991cb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:57.689368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2555d2a7-9415-49e1-bb3b-11f41d6991cb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:57.689368 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2555d2a7-9415-49e1-bb3b-11f41d6991cb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:57.816628 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2555d2a7-9415-49e1-bb3b-11f41d6991cb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:57.825088 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2555d2a7-9415-49e1-bb3b-11f41d6991cb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.153062 Apr 12 15:14:57.825679 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 676/1327] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:57 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:14:58.842772 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d467c11a-53f0-45e4-a877-0171c354cdd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:14:58.843398 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d467c11a-53f0-45e4-a877-0171c354cdd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:14:58.849902 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d467c11a-53f0-45e4-a877-0171c354cdd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:58.850349 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d467c11a-53f0-45e4-a877-0171c354cdd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:58.851128 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d467c11a-53f0-45e4-a877-0171c354cdd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:14:58.851559 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d467c11a-53f0-45e4-a877-0171c354cdd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:14:58.989604 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d467c11a-53f0-45e4-a877-0171c354cdd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:14:58.997918 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d467c11a-53f0-45e4-a877-0171c354cdd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.159023 Apr 12 15:14:58.998496 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 652/1328] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:14:58 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:15:00.016427 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-efae3499-5ccf-4990-8476-004b1310ac3b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:00.017076 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-efae3499-5ccf-4990-8476-004b1310ac3b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:00.023301 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efae3499-5ccf-4990-8476-004b1310ac3b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:00.023738 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efae3499-5ccf-4990-8476-004b1310ac3b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:00.024500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efae3499-5ccf-4990-8476-004b1310ac3b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:00.025053 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-efae3499-5ccf-4990-8476-004b1310ac3b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:00.179475 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-efae3499-5ccf-4990-8476-004b1310ac3b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:00.187945 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-efae3499-5ccf-4990-8476-004b1310ac3b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.175345 Apr 12 15:15:00.188518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 677/1329] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:00 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:01.206561 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3c1c98e9-2c69-4001-8b73-0ad2976ee4b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:01.207172 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3c1c98e9-2c69-4001-8b73-0ad2976ee4b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:01.214800 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3c1c98e9-2c69-4001-8b73-0ad2976ee4b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:01.215241 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3c1c98e9-2c69-4001-8b73-0ad2976ee4b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:01.216108 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3c1c98e9-2c69-4001-8b73-0ad2976ee4b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:01.216541 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3c1c98e9-2c69-4001-8b73-0ad2976ee4b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:01.349075 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3c1c98e9-2c69-4001-8b73-0ad2976ee4b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:01.357009 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3c1c98e9-2c69-4001-8b73-0ad2976ee4b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154331 Apr 12 15:15:01.357583 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 653/1330] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:01 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:02.374411 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ef85d2ae-6eeb-4be2-89bc-f33d29bc22d2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:02.375017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ef85d2ae-6eeb-4be2-89bc-f33d29bc22d2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:02.381277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef85d2ae-6eeb-4be2-89bc-f33d29bc22d2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:02.381773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef85d2ae-6eeb-4be2-89bc-f33d29bc22d2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:02.382524 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef85d2ae-6eeb-4be2-89bc-f33d29bc22d2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:02.383079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef85d2ae-6eeb-4be2-89bc-f33d29bc22d2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:02.505923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ef85d2ae-6eeb-4be2-89bc-f33d29bc22d2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:02.513747 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ef85d2ae-6eeb-4be2-89bc-f33d29bc22d2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.143130 Apr 12 15:15:02.514305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 678/1331] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:02 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:03.531200 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-55d4f51c-3e65-4ca6-832a-c7e1d461df9c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:03.531809 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-55d4f51c-3e65-4ca6-832a-c7e1d461df9c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:03.538614 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-55d4f51c-3e65-4ca6-832a-c7e1d461df9c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:03.539071 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-55d4f51c-3e65-4ca6-832a-c7e1d461df9c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:03.540418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-55d4f51c-3e65-4ca6-832a-c7e1d461df9c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:03.540866 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-55d4f51c-3e65-4ca6-832a-c7e1d461df9c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:03.671709 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-55d4f51c-3e65-4ca6-832a-c7e1d461df9c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:03.679896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-55d4f51c-3e65-4ca6-832a-c7e1d461df9c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152579 Apr 12 15:15:03.680502 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 654/1332] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:03 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:04.697277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-21a8e435-609a-47be-b94c-4f1d553a7d54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:04.697892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-21a8e435-609a-47be-b94c-4f1d553a7d54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:04.704187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21a8e435-609a-47be-b94c-4f1d553a7d54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:04.704632 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21a8e435-609a-47be-b94c-4f1d553a7d54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:04.705395 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21a8e435-609a-47be-b94c-4f1d553a7d54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:04.705864 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21a8e435-609a-47be-b94c-4f1d553a7d54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:04.837552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-21a8e435-609a-47be-b94c-4f1d553a7d54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:04.845523 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-21a8e435-609a-47be-b94c-4f1d553a7d54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152341 Apr 12 15:15:04.846122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 679/1333] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:04 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:05.862960 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-cc8ca03d-048b-4a61-96ba-d902994d8847 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:05.863600 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cc8ca03d-048b-4a61-96ba-d902994d8847 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:05.870196 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cc8ca03d-048b-4a61-96ba-d902994d8847 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:05.870639 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cc8ca03d-048b-4a61-96ba-d902994d8847 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:05.871413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cc8ca03d-048b-4a61-96ba-d902994d8847 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:05.871838 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cc8ca03d-048b-4a61-96ba-d902994d8847 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:05.999369 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-cc8ca03d-048b-4a61-96ba-d902994d8847 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:06.007158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-cc8ca03d-048b-4a61-96ba-d902994d8847 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148293 Apr 12 15:15:06.007729 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 655/1334] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:05 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:07.025703 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5494d337-92d3-4f22-9210-17d798470e94 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:07.026500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5494d337-92d3-4f22-9210-17d798470e94 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:07.034019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5494d337-92d3-4f22-9210-17d798470e94 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:07.034459 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5494d337-92d3-4f22-9210-17d798470e94 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:07.035430 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5494d337-92d3-4f22-9210-17d798470e94 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:07.035859 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5494d337-92d3-4f22-9210-17d798470e94 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:07.210032 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5494d337-92d3-4f22-9210-17d798470e94 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:07.222059 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5494d337-92d3-4f22-9210-17d798470e94 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.200624 Apr 12 15:15:07.222661 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 680/1335] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:07 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:08.245232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4b25d4a7-1a4b-4bc2-b0d8-408f130378a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:08.246363 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4b25d4a7-1a4b-4bc2-b0d8-408f130378a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:08.255724 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4b25d4a7-1a4b-4bc2-b0d8-408f130378a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:08.256175 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4b25d4a7-1a4b-4bc2-b0d8-408f130378a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:08.256967 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4b25d4a7-1a4b-4bc2-b0d8-408f130378a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:08.257409 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4b25d4a7-1a4b-4bc2-b0d8-408f130378a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:08.392035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4b25d4a7-1a4b-4bc2-b0d8-408f130378a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:08.400948 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4b25d4a7-1a4b-4bc2-b0d8-408f130378a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.163440 Apr 12 15:15:08.401517 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 656/1336] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:08 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:09.418913 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5b4896d4-9480-483c-b052-f086e4c11d75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:09.419526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5b4896d4-9480-483c-b052-f086e4c11d75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:09.425944 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b4896d4-9480-483c-b052-f086e4c11d75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:09.426392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b4896d4-9480-483c-b052-f086e4c11d75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:09.427166 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b4896d4-9480-483c-b052-f086e4c11d75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:09.427597 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b4896d4-9480-483c-b052-f086e4c11d75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:09.560208 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5b4896d4-9480-483c-b052-f086e4c11d75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:09.568927 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5b4896d4-9480-483c-b052-f086e4c11d75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154740 Apr 12 15:15:09.569492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 681/1337] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:09 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:10.587696 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7b01eced-0f9e-4b62-b461-a1bed49a1d57 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:10.588760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7b01eced-0f9e-4b62-b461-a1bed49a1d57 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:10.596228 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b01eced-0f9e-4b62-b461-a1bed49a1d57 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:10.596687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b01eced-0f9e-4b62-b461-a1bed49a1d57 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:10.597483 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b01eced-0f9e-4b62-b461-a1bed49a1d57 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:10.598024 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7b01eced-0f9e-4b62-b461-a1bed49a1d57 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:10.738088 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7b01eced-0f9e-4b62-b461-a1bed49a1d57 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:10.746477 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7b01eced-0f9e-4b62-b461-a1bed49a1d57 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.163005 Apr 12 15:15:10.747056 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 657/1338] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:10 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:11.762691 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d84a0a09-3619-4881-b7f8-6bb2cbb6de49 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:11.763286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d84a0a09-3619-4881-b7f8-6bb2cbb6de49 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:11.769527 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d84a0a09-3619-4881-b7f8-6bb2cbb6de49 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:11.770017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d84a0a09-3619-4881-b7f8-6bb2cbb6de49 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:11.770777 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d84a0a09-3619-4881-b7f8-6bb2cbb6de49 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:11.771204 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d84a0a09-3619-4881-b7f8-6bb2cbb6de49 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:11.899831 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d84a0a09-3619-4881-b7f8-6bb2cbb6de49 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:11.907717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d84a0a09-3619-4881-b7f8-6bb2cbb6de49 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148891 Apr 12 15:15:11.908289 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 682/1339] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:11 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:12.926410 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7777b9a9-73b7-4abe-9a99-d799a9f242d3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:12.926970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7777b9a9-73b7-4abe-9a99-d799a9f242d3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:12.933275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7777b9a9-73b7-4abe-9a99-d799a9f242d3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:12.933765 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7777b9a9-73b7-4abe-9a99-d799a9f242d3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:12.934538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7777b9a9-73b7-4abe-9a99-d799a9f242d3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:12.934975 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7777b9a9-73b7-4abe-9a99-d799a9f242d3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:13.063089 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7777b9a9-73b7-4abe-9a99-d799a9f242d3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:13.072072 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7777b9a9-73b7-4abe-9a99-d799a9f242d3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148442 Apr 12 15:15:13.072644 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 658/1340] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:12 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:14.089084 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ef645ae8-8766-4946-90ab-27348fc02869 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:14.089708 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ef645ae8-8766-4946-90ab-27348fc02869 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:14.096004 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef645ae8-8766-4946-90ab-27348fc02869 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:14.096441 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef645ae8-8766-4946-90ab-27348fc02869 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:14.097474 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef645ae8-8766-4946-90ab-27348fc02869 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:14.097932 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ef645ae8-8766-4946-90ab-27348fc02869 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:14.226707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ef645ae8-8766-4946-90ab-27348fc02869 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:14.234722 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ef645ae8-8766-4946-90ab-27348fc02869 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150291 Apr 12 15:15:14.235453 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 683/1341] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:14 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:15.252298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-30f545b5-9cef-444c-b9d3-4b0e91af6f55 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:15.252910 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-30f545b5-9cef-444c-b9d3-4b0e91af6f55 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:15.259828 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-30f545b5-9cef-444c-b9d3-4b0e91af6f55 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:15.260276 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-30f545b5-9cef-444c-b9d3-4b0e91af6f55 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:15.261053 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-30f545b5-9cef-444c-b9d3-4b0e91af6f55 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:15.261490 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-30f545b5-9cef-444c-b9d3-4b0e91af6f55 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:15.392585 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-30f545b5-9cef-444c-b9d3-4b0e91af6f55 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:15.400957 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-30f545b5-9cef-444c-b9d3-4b0e91af6f55 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152528 Apr 12 15:15:15.401523 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 659/1342] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:15 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:16.418953 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-283602d8-a70a-48c1-83ce-91882adb9abd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:16.419564 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-283602d8-a70a-48c1-83ce-91882adb9abd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:16.425885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-283602d8-a70a-48c1-83ce-91882adb9abd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:16.426332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-283602d8-a70a-48c1-83ce-91882adb9abd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:16.427096 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-283602d8-a70a-48c1-83ce-91882adb9abd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:16.427529 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-283602d8-a70a-48c1-83ce-91882adb9abd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:16.575644 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-283602d8-a70a-48c1-83ce-91882adb9abd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:16.583590 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-283602d8-a70a-48c1-83ce-91882adb9abd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.169604 Apr 12 15:15:16.595861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 684/1343] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:16 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:17.613045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2fa2a915-e925-4186-8f5a-8ebb5dcd24f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:17.613792 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2fa2a915-e925-4186-8f5a-8ebb5dcd24f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:17.621180 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2fa2a915-e925-4186-8f5a-8ebb5dcd24f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:17.621646 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2fa2a915-e925-4186-8f5a-8ebb5dcd24f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:17.622459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2fa2a915-e925-4186-8f5a-8ebb5dcd24f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:17.622892 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2fa2a915-e925-4186-8f5a-8ebb5dcd24f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:17.757289 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2fa2a915-e925-4186-8f5a-8ebb5dcd24f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:17.765284 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2fa2a915-e925-4186-8f5a-8ebb5dcd24f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.156544 Apr 12 15:15:17.765897 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 660/1344] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:17 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:18.783132 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a7b4fc14-7878-4b99-92b8-a97b34990e79 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:18.783721 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a7b4fc14-7878-4b99-92b8-a97b34990e79 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:18.790008 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7b4fc14-7878-4b99-92b8-a97b34990e79 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:18.790430 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7b4fc14-7878-4b99-92b8-a97b34990e79 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:18.791177 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7b4fc14-7878-4b99-92b8-a97b34990e79 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:18.791600 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7b4fc14-7878-4b99-92b8-a97b34990e79 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:18.925894 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a7b4fc14-7878-4b99-92b8-a97b34990e79 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:18.934752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a7b4fc14-7878-4b99-92b8-a97b34990e79 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.155656 Apr 12 15:15:18.935317 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 685/1345] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:18 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:19.951913 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-323a652b-ec3a-4d1d-991a-f10bd6f06dd3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:19.952519 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-323a652b-ec3a-4d1d-991a-f10bd6f06dd3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:19.958478 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-323a652b-ec3a-4d1d-991a-f10bd6f06dd3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:19.958918 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-323a652b-ec3a-4d1d-991a-f10bd6f06dd3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:19.959676 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-323a652b-ec3a-4d1d-991a-f10bd6f06dd3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:19.960100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-323a652b-ec3a-4d1d-991a-f10bd6f06dd3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:20.089078 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-323a652b-ec3a-4d1d-991a-f10bd6f06dd3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:20.096908 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-323a652b-ec3a-4d1d-991a-f10bd6f06dd3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.149007 Apr 12 15:15:20.097474 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 661/1346] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:19 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:21.114829 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-adb477ac-c238-4ad2-8ede-aaaac2a7be72 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:21.115421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-adb477ac-c238-4ad2-8ede-aaaac2a7be72 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:21.122113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adb477ac-c238-4ad2-8ede-aaaac2a7be72 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:21.122562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adb477ac-c238-4ad2-8ede-aaaac2a7be72 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:21.123324 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adb477ac-c238-4ad2-8ede-aaaac2a7be72 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:21.123755 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-adb477ac-c238-4ad2-8ede-aaaac2a7be72 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:21.250575 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-adb477ac-c238-4ad2-8ede-aaaac2a7be72 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:21.258853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-adb477ac-c238-4ad2-8ede-aaaac2a7be72 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.147392 Apr 12 15:15:21.259537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 686/1347] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:21 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:22.276234 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3a073e75-c007-4a1e-ac09-77d837fff700 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:22.276833 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3a073e75-c007-4a1e-ac09-77d837fff700 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:22.283323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a073e75-c007-4a1e-ac09-77d837fff700 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:22.283749 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a073e75-c007-4a1e-ac09-77d837fff700 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:22.284512 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a073e75-c007-4a1e-ac09-77d837fff700 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:22.284939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3a073e75-c007-4a1e-ac09-77d837fff700 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:22.414726 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3a073e75-c007-4a1e-ac09-77d837fff700 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:22.423395 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3a073e75-c007-4a1e-ac09-77d837fff700 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.151243 Apr 12 15:15:22.423968 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 662/1348] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:22 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:23.440533 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f86fd0a2-2612-4299-b96a-a4daa4e9dc5c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:23.441156 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f86fd0a2-2612-4299-b96a-a4daa4e9dc5c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:23.449037 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f86fd0a2-2612-4299-b96a-a4daa4e9dc5c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:23.449480 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f86fd0a2-2612-4299-b96a-a4daa4e9dc5c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:23.450323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f86fd0a2-2612-4299-b96a-a4daa4e9dc5c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:23.450706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f86fd0a2-2612-4299-b96a-a4daa4e9dc5c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:23.581914 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f86fd0a2-2612-4299-b96a-a4daa4e9dc5c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:23.588002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f86fd0a2-2612-4299-b96a-a4daa4e9dc5c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.151318 Apr 12 15:15:23.588573 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 687/1349] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:23 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:24.605470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-eb7285aa-6670-4eda-ab3c-0feac32ba097 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:24.606223 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-eb7285aa-6670-4eda-ab3c-0feac32ba097 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:24.612848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eb7285aa-6670-4eda-ab3c-0feac32ba097 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:24.614431 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eb7285aa-6670-4eda-ab3c-0feac32ba097 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:24.614431 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eb7285aa-6670-4eda-ab3c-0feac32ba097 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:24.614655 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-eb7285aa-6670-4eda-ab3c-0feac32ba097 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:24.747656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-eb7285aa-6670-4eda-ab3c-0feac32ba097 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:24.753618 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-eb7285aa-6670-4eda-ab3c-0feac32ba097 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152450 Apr 12 15:15:24.754217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 663/1350] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:24 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:25.771593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5b8d90a3-c89c-4c1c-a639-c4928c26c8a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:25.772193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5b8d90a3-c89c-4c1c-a639-c4928c26c8a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:25.780030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b8d90a3-c89c-4c1c-a639-c4928c26c8a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:25.780469 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b8d90a3-c89c-4c1c-a639-c4928c26c8a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:25.781224 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b8d90a3-c89c-4c1c-a639-c4928c26c8a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:25.781663 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5b8d90a3-c89c-4c1c-a639-c4928c26c8a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:25.907780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5b8d90a3-c89c-4c1c-a639-c4928c26c8a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:25.916325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5b8d90a3-c89c-4c1c-a639-c4928c26c8a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148513 Apr 12 15:15:25.917528 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 688/1351] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:25 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:26.934490 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-01230168-6374-4786-bd4a-abdb5143d671 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:26.935208 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-01230168-6374-4786-bd4a-abdb5143d671 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:26.941491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-01230168-6374-4786-bd4a-abdb5143d671 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:26.941963 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-01230168-6374-4786-bd4a-abdb5143d671 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:26.942718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-01230168-6374-4786-bd4a-abdb5143d671 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:26.943144 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-01230168-6374-4786-bd4a-abdb5143d671 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:27.082876 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-01230168-6374-4786-bd4a-abdb5143d671 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:27.092526 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-01230168-6374-4786-bd4a-abdb5143d671 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.161751 Apr 12 15:15:27.093872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 664/1352] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:26 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:28.112137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9b0ae6dd-f796-42b8-ae03-5cb3eb29cc98 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:28.112755 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9b0ae6dd-f796-42b8-ae03-5cb3eb29cc98 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:28.119653 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b0ae6dd-f796-42b8-ae03-5cb3eb29cc98 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:28.120185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b0ae6dd-f796-42b8-ae03-5cb3eb29cc98 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:28.120984 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b0ae6dd-f796-42b8-ae03-5cb3eb29cc98 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:28.121411 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9b0ae6dd-f796-42b8-ae03-5cb3eb29cc98 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:28.247825 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9b0ae6dd-f796-42b8-ae03-5cb3eb29cc98 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:28.262940 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9b0ae6dd-f796-42b8-ae03-5cb3eb29cc98 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154892 Apr 12 15:15:28.263526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 689/1353] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:28 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:29.280237 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-aa70a0cf-e876-446e-aeed-6ae32115ac18 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:29.280845 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-aa70a0cf-e876-446e-aeed-6ae32115ac18 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:29.287215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa70a0cf-e876-446e-aeed-6ae32115ac18 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:29.287666 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa70a0cf-e876-446e-aeed-6ae32115ac18 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:29.288433 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa70a0cf-e876-446e-aeed-6ae32115ac18 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:29.289206 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa70a0cf-e876-446e-aeed-6ae32115ac18 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:29.420780 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-aa70a0cf-e876-446e-aeed-6ae32115ac18 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:29.428787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-aa70a0cf-e876-446e-aeed-6ae32115ac18 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152383 Apr 12 15:15:29.429953 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 665/1354] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:29 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:30.446975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-21ae3617-cf42-4a48-adfc-ad0e35e2a028 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:30.447608 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-21ae3617-cf42-4a48-adfc-ad0e35e2a028 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:30.453944 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21ae3617-cf42-4a48-adfc-ad0e35e2a028 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:30.454392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21ae3617-cf42-4a48-adfc-ad0e35e2a028 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:30.455153 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21ae3617-cf42-4a48-adfc-ad0e35e2a028 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:30.455581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21ae3617-cf42-4a48-adfc-ad0e35e2a028 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:30.587363 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-21ae3617-cf42-4a48-adfc-ad0e35e2a028 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:30.595700 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-21ae3617-cf42-4a48-adfc-ad0e35e2a028 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152623 Apr 12 15:15:30.596255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 690/1355] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:30 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:31.614942 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e5559505-2128-4510-a81d-11ffbf684a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:31.615544 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e5559505-2128-4510-a81d-11ffbf684a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:31.622419 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e5559505-2128-4510-a81d-11ffbf684a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:31.623256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e5559505-2128-4510-a81d-11ffbf684a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:31.623704 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e5559505-2128-4510-a81d-11ffbf684a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:31.624142 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e5559505-2128-4510-a81d-11ffbf684a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:31.748735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e5559505-2128-4510-a81d-11ffbf684a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:31.758242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e5559505-2128-4510-a81d-11ffbf684a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.146425 Apr 12 15:15:31.758819 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 666/1356] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:31 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:32.777976 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d6a31ad2-47ee-49b8-a24b-f22c73f89117 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:32.778618 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d6a31ad2-47ee-49b8-a24b-f22c73f89117 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:32.785053 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6a31ad2-47ee-49b8-a24b-f22c73f89117 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:32.785436 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6a31ad2-47ee-49b8-a24b-f22c73f89117 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:32.786264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6a31ad2-47ee-49b8-a24b-f22c73f89117 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:32.786678 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d6a31ad2-47ee-49b8-a24b-f22c73f89117 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:33.173583 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d6a31ad2-47ee-49b8-a24b-f22c73f89117 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:33.182191 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d6a31ad2-47ee-49b8-a24b-f22c73f89117 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.408693 Apr 12 15:15:33.182761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 691/1357] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:32 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:34.199341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9a9ff8a2-7092-4326-bc26-3af3e657612e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:34.199977 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9a9ff8a2-7092-4326-bc26-3af3e657612e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:34.206255 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9a9ff8a2-7092-4326-bc26-3af3e657612e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:34.206697 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9a9ff8a2-7092-4326-bc26-3af3e657612e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:34.207455 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9a9ff8a2-7092-4326-bc26-3af3e657612e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:34.207885 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9a9ff8a2-7092-4326-bc26-3af3e657612e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:34.340242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9a9ff8a2-7092-4326-bc26-3af3e657612e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:34.358319 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9a9ff8a2-7092-4326-bc26-3af3e657612e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.162803 Apr 12 15:15:34.358908 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 667/1358] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:34 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:35.376952 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-21cf043b-1076-4d77-91cd-937bac4c9d5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:35.377534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-21cf043b-1076-4d77-91cd-937bac4c9d5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:35.384953 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21cf043b-1076-4d77-91cd-937bac4c9d5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:35.385395 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21cf043b-1076-4d77-91cd-937bac4c9d5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:35.386190 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21cf043b-1076-4d77-91cd-937bac4c9d5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:35.386621 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-21cf043b-1076-4d77-91cd-937bac4c9d5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:35.520494 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-21cf043b-1076-4d77-91cd-937bac4c9d5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:35.528823 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-21cf043b-1076-4d77-91cd-937bac4c9d5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.155749 Apr 12 15:15:35.529416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 692/1359] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:35 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:36.546978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5d0452d9-74d6-4e88-a66f-bc23cefc33b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:36.547587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5d0452d9-74d6-4e88-a66f-bc23cefc33b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:36.553916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5d0452d9-74d6-4e88-a66f-bc23cefc33b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:36.555032 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5d0452d9-74d6-4e88-a66f-bc23cefc33b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:36.555919 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5d0452d9-74d6-4e88-a66f-bc23cefc33b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:36.556353 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5d0452d9-74d6-4e88-a66f-bc23cefc33b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:36.688919 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5d0452d9-74d6-4e88-a66f-bc23cefc33b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:36.697237 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5d0452d9-74d6-4e88-a66f-bc23cefc33b7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154078 Apr 12 15:15:36.697839 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 668/1360] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:36 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:37.715685 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7fda6a7f-796a-40cb-8dee-859052df680b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:37.716312 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7fda6a7f-796a-40cb-8dee-859052df680b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:37.723373 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7fda6a7f-796a-40cb-8dee-859052df680b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:37.723811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7fda6a7f-796a-40cb-8dee-859052df680b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:37.724577 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7fda6a7f-796a-40cb-8dee-859052df680b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:37.725001 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7fda6a7f-796a-40cb-8dee-859052df680b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:37.857778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7fda6a7f-796a-40cb-8dee-859052df680b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:37.865625 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7fda6a7f-796a-40cb-8dee-859052df680b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154096 Apr 12 15:15:37.866209 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 693/1361] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:37 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:38.883518 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8d74c8ba-cbb4-4a63-86d6-d6d63499d38e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:38.884119 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8d74c8ba-cbb4-4a63-86d6-d6d63499d38e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:38.890486 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d74c8ba-cbb4-4a63-86d6-d6d63499d38e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:38.890929 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d74c8ba-cbb4-4a63-86d6-d6d63499d38e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:38.891686 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d74c8ba-cbb4-4a63-86d6-d6d63499d38e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:38.892115 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8d74c8ba-cbb4-4a63-86d6-d6d63499d38e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:39.022115 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8d74c8ba-cbb4-4a63-86d6-d6d63499d38e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:39.030554 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8d74c8ba-cbb4-4a63-86d6-d6d63499d38e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150858 Apr 12 15:15:39.031207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 669/1362] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:38 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:40.048280 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-678c2250-04e8-4b83-864c-46458099869c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:40.049030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-678c2250-04e8-4b83-864c-46458099869c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:40.056073 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-678c2250-04e8-4b83-864c-46458099869c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:40.056550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-678c2250-04e8-4b83-864c-46458099869c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:40.057324 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-678c2250-04e8-4b83-864c-46458099869c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:40.057785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-678c2250-04e8-4b83-864c-46458099869c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:40.203835 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-678c2250-04e8-4b83-864c-46458099869c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:40.212056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-678c2250-04e8-4b83-864c-46458099869c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.167618 Apr 12 15:15:40.212626 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 694/1363] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:40 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:41.229982 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d75c914b-5e97-4cf0-b33b-a086731fa222 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:41.230806 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d75c914b-5e97-4cf0-b33b-a086731fa222 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:41.237083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d75c914b-5e97-4cf0-b33b-a086731fa222 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:41.237526 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d75c914b-5e97-4cf0-b33b-a086731fa222 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:41.238308 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d75c914b-5e97-4cf0-b33b-a086731fa222 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:41.238733 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d75c914b-5e97-4cf0-b33b-a086731fa222 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:41.371698 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d75c914b-5e97-4cf0-b33b-a086731fa222 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:41.382958 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d75c914b-5e97-4cf0-b33b-a086731fa222 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.156646 Apr 12 15:15:41.383988 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 670/1364] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:41 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:42.401460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9fe75037-09c7-4c9c-af2e-74708099230f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:42.402156 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9fe75037-09c7-4c9c-af2e-74708099230f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:42.408445 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fe75037-09c7-4c9c-af2e-74708099230f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:42.408892 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fe75037-09c7-4c9c-af2e-74708099230f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:42.409676 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fe75037-09c7-4c9c-af2e-74708099230f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:42.410114 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9fe75037-09c7-4c9c-af2e-74708099230f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:42.535574 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9fe75037-09c7-4c9c-af2e-74708099230f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:42.544524 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9fe75037-09c7-4c9c-af2e-74708099230f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.147519 Apr 12 15:15:42.545808 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 695/1365] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:42 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:43.561254 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7f87c537-80a2-43bd-90da-b28402a3b7b1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:43.561952 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7f87c537-80a2-43bd-90da-b28402a3b7b1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:43.568233 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7f87c537-80a2-43bd-90da-b28402a3b7b1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:43.568656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7f87c537-80a2-43bd-90da-b28402a3b7b1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:43.569623 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7f87c537-80a2-43bd-90da-b28402a3b7b1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:43.570082 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7f87c537-80a2-43bd-90da-b28402a3b7b1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:43.703507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7f87c537-80a2-43bd-90da-b28402a3b7b1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:43.711786 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7f87c537-80a2-43bd-90da-b28402a3b7b1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154469 Apr 12 15:15:43.712351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 671/1366] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:43 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:44.729044 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-03101f00-4629-4344-afde-2f7f00e7f2f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:44.729675 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-03101f00-4629-4344-afde-2f7f00e7f2f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:44.736290 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03101f00-4629-4344-afde-2f7f00e7f2f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:44.736740 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03101f00-4629-4344-afde-2f7f00e7f2f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:44.737515 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03101f00-4629-4344-afde-2f7f00e7f2f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:44.737976 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-03101f00-4629-4344-afde-2f7f00e7f2f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:44.861420 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-03101f00-4629-4344-afde-2f7f00e7f2f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:44.870108 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-03101f00-4629-4344-afde-2f7f00e7f2f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.145614 Apr 12 15:15:44.870670 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 696/1367] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:44 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:15:45.887788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8a9b2899-afe1-4a3c-9e27-56ae3c06237f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:45.888339 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8a9b2899-afe1-4a3c-9e27-56ae3c06237f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:45.894718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8a9b2899-afe1-4a3c-9e27-56ae3c06237f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:45.895161 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8a9b2899-afe1-4a3c-9e27-56ae3c06237f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:45.895910 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8a9b2899-afe1-4a3c-9e27-56ae3c06237f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:45.896339 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8a9b2899-afe1-4a3c-9e27-56ae3c06237f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:46.024791 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8a9b2899-afe1-4a3c-9e27-56ae3c06237f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:46.032453 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8a9b2899-afe1-4a3c-9e27-56ae3c06237f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148615 Apr 12 15:15:46.033064 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 672/1368] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:45 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:47.050726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1815cb0f-02bd-47b9-b42b-7cd34fae61b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:47.051291 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1815cb0f-02bd-47b9-b42b-7cd34fae61b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:47.058414 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1815cb0f-02bd-47b9-b42b-7cd34fae61b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:47.058864 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1815cb0f-02bd-47b9-b42b-7cd34fae61b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:47.059638 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1815cb0f-02bd-47b9-b42b-7cd34fae61b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:47.060073 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1815cb0f-02bd-47b9-b42b-7cd34fae61b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:47.191013 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1815cb0f-02bd-47b9-b42b-7cd34fae61b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:47.199467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1815cb0f-02bd-47b9-b42b-7cd34fae61b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152651 Apr 12 15:15:47.200050 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 697/1369] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:47 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:48.217037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1e62ec3b-4e97-4002-bee5-299e5732b2f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:48.217664 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1e62ec3b-4e97-4002-bee5-299e5732b2f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:48.224034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1e62ec3b-4e97-4002-bee5-299e5732b2f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:48.224479 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1e62ec3b-4e97-4002-bee5-299e5732b2f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:48.225245 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1e62ec3b-4e97-4002-bee5-299e5732b2f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:48.226331 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1e62ec3b-4e97-4002-bee5-299e5732b2f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:48.357202 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1e62ec3b-4e97-4002-bee5-299e5732b2f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:48.365230 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1e62ec3b-4e97-4002-bee5-299e5732b2f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152186 Apr 12 15:15:48.367048 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 673/1370] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:48 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:15:49.448148 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-92ead6b2-85e1-4f7b-9064-30f203aa8557 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:49.448739 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-92ead6b2-85e1-4f7b-9064-30f203aa8557 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:49.455091 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-92ead6b2-85e1-4f7b-9064-30f203aa8557 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:49.455536 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-92ead6b2-85e1-4f7b-9064-30f203aa8557 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:49.456298 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-92ead6b2-85e1-4f7b-9064-30f203aa8557 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:49.456726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-92ead6b2-85e1-4f7b-9064-30f203aa8557 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:49.596474 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-92ead6b2-85e1-4f7b-9064-30f203aa8557 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:49.597109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-92ead6b2-85e1-4f7b-9064-30f203aa8557 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.153430 Apr 12 15:15:49.597687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 698/1371] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:49 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:50.614297 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dafe9ef8-b960-4df4-9d63-0d4a44a01306 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:50.614890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dafe9ef8-b960-4df4-9d63-0d4a44a01306 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:50.621427 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dafe9ef8-b960-4df4-9d63-0d4a44a01306 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:50.621903 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dafe9ef8-b960-4df4-9d63-0d4a44a01306 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:50.622662 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dafe9ef8-b960-4df4-9d63-0d4a44a01306 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:50.623091 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dafe9ef8-b960-4df4-9d63-0d4a44a01306 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:50.750935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dafe9ef8-b960-4df4-9d63-0d4a44a01306 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:50.759224 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dafe9ef8-b960-4df4-9d63-0d4a44a01306 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148773 Apr 12 15:15:50.759806 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 674/1372] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:50 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:51.776319 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bdbdbaba-e168-469c-abef-21907924be0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:51.776961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bdbdbaba-e168-469c-abef-21907924be0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:51.786199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bdbdbaba-e168-469c-abef-21907924be0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:51.786587 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bdbdbaba-e168-469c-abef-21907924be0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:51.787358 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bdbdbaba-e168-469c-abef-21907924be0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:51.787836 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bdbdbaba-e168-469c-abef-21907924be0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:51.917893 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bdbdbaba-e168-469c-abef-21907924be0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:51.925789 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bdbdbaba-e168-469c-abef-21907924be0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.153271 Apr 12 15:15:51.926346 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 699/1373] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:51 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:52.943192 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f72495ca-b02d-4e81-8f10-4e419e442600 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:52.943748 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f72495ca-b02d-4e81-8f10-4e419e442600 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:52.950205 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f72495ca-b02d-4e81-8f10-4e419e442600 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:52.950644 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f72495ca-b02d-4e81-8f10-4e419e442600 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:52.951407 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f72495ca-b02d-4e81-8f10-4e419e442600 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:52.951834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f72495ca-b02d-4e81-8f10-4e419e442600 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:53.079474 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f72495ca-b02d-4e81-8f10-4e419e442600 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:53.087467 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f72495ca-b02d-4e81-8f10-4e419e442600 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148180 Apr 12 15:15:53.088306 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 675/1374] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:52 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:54.113370 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5cf61889-4071-49c5-9f87-bde3171f4522 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:54.113370 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5cf61889-4071-49c5-9f87-bde3171f4522 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:54.119122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cf61889-4071-49c5-9f87-bde3171f4522 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:54.119572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cf61889-4071-49c5-9f87-bde3171f4522 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:54.120346 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cf61889-4071-49c5-9f87-bde3171f4522 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:54.120780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cf61889-4071-49c5-9f87-bde3171f4522 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:54.247771 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5cf61889-4071-49c5-9f87-bde3171f4522 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:54.255701 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5cf61889-4071-49c5-9f87-bde3171f4522 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.147483 Apr 12 15:15:54.257147 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 700/1375] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:54 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:55.279114 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0bf61c34-3563-4b74-a4c6-78e266627f71 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:55.279722 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0bf61c34-3563-4b74-a4c6-78e266627f71 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:55.287104 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bf61c34-3563-4b74-a4c6-78e266627f71 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:55.287548 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bf61c34-3563-4b74-a4c6-78e266627f71 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:55.289121 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bf61c34-3563-4b74-a4c6-78e266627f71 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:55.289552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bf61c34-3563-4b74-a4c6-78e266627f71 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:55.420355 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0bf61c34-3563-4b74-a4c6-78e266627f71 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:55.428108 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0bf61c34-3563-4b74-a4c6-78e266627f71 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152942 Apr 12 15:15:55.429475 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 676/1376] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:55 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:56.445877 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f681ceac-09c6-4729-900b-2e4796313d30 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:56.446419 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f681ceac-09c6-4729-900b-2e4796313d30 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:56.453241 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f681ceac-09c6-4729-900b-2e4796313d30 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:56.453710 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f681ceac-09c6-4729-900b-2e4796313d30 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:56.454463 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f681ceac-09c6-4729-900b-2e4796313d30 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:56.454887 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f681ceac-09c6-4729-900b-2e4796313d30 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:56.580002 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f681ceac-09c6-4729-900b-2e4796313d30 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:56.587791 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f681ceac-09c6-4729-900b-2e4796313d30 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.145817 Apr 12 15:15:56.588347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 701/1377] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:56 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:57.604887 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7d9cace8-6429-4d9e-a9a8-5731327d3142 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:57.605478 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7d9cace8-6429-4d9e-a9a8-5731327d3142 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:57.611818 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7d9cace8-6429-4d9e-a9a8-5731327d3142 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:57.612264 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7d9cace8-6429-4d9e-a9a8-5731327d3142 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:57.613030 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7d9cace8-6429-4d9e-a9a8-5731327d3142 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:57.613459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7d9cace8-6429-4d9e-a9a8-5731327d3142 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:57.746846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7d9cace8-6429-4d9e-a9a8-5731327d3142 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:57.754710 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7d9cace8-6429-4d9e-a9a8-5731327d3142 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.153803 Apr 12 15:15:57.755209 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 677/1378] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:57 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:58.772678 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5cbdc43b-cac7-46f8-94c3-a9b6683d15be tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:58.773620 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5cbdc43b-cac7-46f8-94c3-a9b6683d15be tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:58.779881 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cbdc43b-cac7-46f8-94c3-a9b6683d15be tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:58.780323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cbdc43b-cac7-46f8-94c3-a9b6683d15be tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:58.781074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cbdc43b-cac7-46f8-94c3-a9b6683d15be tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:58.781545 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5cbdc43b-cac7-46f8-94c3-a9b6683d15be tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:58.912467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5cbdc43b-cac7-46f8-94c3-a9b6683d15be tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:15:58.920547 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5cbdc43b-cac7-46f8-94c3-a9b6683d15be tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152389 Apr 12 15:15:58.921110 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 702/1379] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:58 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:15:59.937393 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5c2ff5ee-ba2a-404c-ae5d-dfed432c7b5a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:15:59.938049 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5c2ff5ee-ba2a-404c-ae5d-dfed432c7b5a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:15:59.945015 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5c2ff5ee-ba2a-404c-ae5d-dfed432c7b5a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:59.945457 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5c2ff5ee-ba2a-404c-ae5d-dfed432c7b5a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:15:59.946244 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5c2ff5ee-ba2a-404c-ae5d-dfed432c7b5a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:15:59.946672 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5c2ff5ee-ba2a-404c-ae5d-dfed432c7b5a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:00.076829 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5c2ff5ee-ba2a-404c-ae5d-dfed432c7b5a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:00.084892 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5c2ff5ee-ba2a-404c-ae5d-dfed432c7b5a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.151231 Apr 12 15:16:00.085473 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 678/1380] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:15:59 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:01.101959 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7d99e0b4-503d-44db-9d9a-d7be2bdbc816 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:01.102573 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7d99e0b4-503d-44db-9d9a-d7be2bdbc816 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:01.108886 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d99e0b4-503d-44db-9d9a-d7be2bdbc816 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:01.109338 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d99e0b4-503d-44db-9d9a-d7be2bdbc816 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:01.110134 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d99e0b4-503d-44db-9d9a-d7be2bdbc816 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:01.110562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7d99e0b4-503d-44db-9d9a-d7be2bdbc816 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:01.235218 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7d99e0b4-503d-44db-9d9a-d7be2bdbc816 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:01.243239 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7d99e0b4-503d-44db-9d9a-d7be2bdbc816 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.145678 Apr 12 15:16:01.243811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 703/1381] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:01 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:02.260955 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c4284c2a-ffa7-4407-ba9d-7a9db9e50cd0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:02.261518 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c4284c2a-ffa7-4407-ba9d-7a9db9e50cd0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:02.267819 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c4284c2a-ffa7-4407-ba9d-7a9db9e50cd0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:02.268268 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c4284c2a-ffa7-4407-ba9d-7a9db9e50cd0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:02.269036 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c4284c2a-ffa7-4407-ba9d-7a9db9e50cd0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:02.269466 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c4284c2a-ffa7-4407-ba9d-7a9db9e50cd0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:02.394643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c4284c2a-ffa7-4407-ba9d-7a9db9e50cd0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:02.402841 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c4284c2a-ffa7-4407-ba9d-7a9db9e50cd0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.146406 Apr 12 15:16:02.403412 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 679/1382] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:02 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:03.420409 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5761efec-1251-430c-8690-c73046536629 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:03.421014 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5761efec-1251-430c-8690-c73046536629 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:03.427372 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5761efec-1251-430c-8690-c73046536629 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:03.427814 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5761efec-1251-430c-8690-c73046536629 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:03.429402 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5761efec-1251-430c-8690-c73046536629 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:03.429646 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5761efec-1251-430c-8690-c73046536629 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:03.575343 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5761efec-1251-430c-8690-c73046536629 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:03.583352 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5761efec-1251-430c-8690-c73046536629 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.166847 Apr 12 15:16:03.585020 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 704/1383] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:03 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:04.600351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3aa58bb4-01b7-4436-bfc3-bf77a0b03674 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:04.601122 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3aa58bb4-01b7-4436-bfc3-bf77a0b03674 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:04.607795 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3aa58bb4-01b7-4436-bfc3-bf77a0b03674 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:04.608252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3aa58bb4-01b7-4436-bfc3-bf77a0b03674 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:04.609084 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3aa58bb4-01b7-4436-bfc3-bf77a0b03674 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:04.609457 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3aa58bb4-01b7-4436-bfc3-bf77a0b03674 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:04.740313 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3aa58bb4-01b7-4436-bfc3-bf77a0b03674 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:04.748606 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3aa58bb4-01b7-4436-bfc3-bf77a0b03674 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152243 Apr 12 15:16:04.750755 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 680/1384] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:04 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:16:05.766127 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ea009fbf-71fe-41c4-925c-d3284c44a172 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:05.766752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ea009fbf-71fe-41c4-925c-d3284c44a172 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:05.773162 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea009fbf-71fe-41c4-925c-d3284c44a172 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:05.773598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea009fbf-71fe-41c4-925c-d3284c44a172 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:05.774384 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea009fbf-71fe-41c4-925c-d3284c44a172 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:05.774808 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ea009fbf-71fe-41c4-925c-d3284c44a172 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:05.907669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ea009fbf-71fe-41c4-925c-d3284c44a172 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:05.916558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ea009fbf-71fe-41c4-925c-d3284c44a172 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154192 Apr 12 15:16:05.917494 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 705/1385] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:05 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:06.934121 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6421aedb-0962-4097-ba8e-56780cfec54d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:06.934690 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6421aedb-0962-4097-ba8e-56780cfec54d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:06.941331 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6421aedb-0962-4097-ba8e-56780cfec54d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:06.941807 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6421aedb-0962-4097-ba8e-56780cfec54d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:06.942620 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6421aedb-0962-4097-ba8e-56780cfec54d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:06.943046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6421aedb-0962-4097-ba8e-56780cfec54d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:07.105799 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6421aedb-0962-4097-ba8e-56780cfec54d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:07.115178 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6421aedb-0962-4097-ba8e-56780cfec54d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.184686 Apr 12 15:16:07.116198 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 681/1386] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:06 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:16:08.132764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-60a14ba6-4777-40ac-b6ef-0591c8fe01d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:08.133433 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-60a14ba6-4777-40ac-b6ef-0591c8fe01d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:08.139635 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60a14ba6-4777-40ac-b6ef-0591c8fe01d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:08.140075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60a14ba6-4777-40ac-b6ef-0591c8fe01d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:08.140826 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60a14ba6-4777-40ac-b6ef-0591c8fe01d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:08.141253 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-60a14ba6-4777-40ac-b6ef-0591c8fe01d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:08.266131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-60a14ba6-4777-40ac-b6ef-0591c8fe01d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:08.274707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-60a14ba6-4777-40ac-b6ef-0591c8fe01d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.145733 Apr 12 15:16:08.275293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 706/1387] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:08 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:09.292452 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6b893344-76fb-47bf-972c-9d634145b4d4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:09.293099 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6b893344-76fb-47bf-972c-9d634145b4d4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:09.299597 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6b893344-76fb-47bf-972c-9d634145b4d4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:09.300043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6b893344-76fb-47bf-972c-9d634145b4d4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:09.300837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6b893344-76fb-47bf-972c-9d634145b4d4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:09.301272 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6b893344-76fb-47bf-972c-9d634145b4d4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:09.433855 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6b893344-76fb-47bf-972c-9d634145b4d4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:09.441719 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6b893344-76fb-47bf-972c-9d634145b4d4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.153486 Apr 12 15:16:09.442292 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 682/1388] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:09 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:10.458026 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ce61e82b-f96f-4b80-91e5-74471fcccce5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:10.458642 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ce61e82b-f96f-4b80-91e5-74471fcccce5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:10.465426 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ce61e82b-f96f-4b80-91e5-74471fcccce5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:10.465912 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ce61e82b-f96f-4b80-91e5-74471fcccce5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:10.466676 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ce61e82b-f96f-4b80-91e5-74471fcccce5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:10.467097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ce61e82b-f96f-4b80-91e5-74471fcccce5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:10.602481 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ce61e82b-f96f-4b80-91e5-74471fcccce5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:10.604440 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ce61e82b-f96f-4b80-91e5-74471fcccce5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150258 Apr 12 15:16:10.605017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 707/1389] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:10 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:16:11.621908 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d9403f69-e1a6-49a2-849e-f6b9f5d312c0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:11.622495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d9403f69-e1a6-49a2-849e-f6b9f5d312c0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:11.630018 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d9403f69-e1a6-49a2-849e-f6b9f5d312c0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:11.631452 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d9403f69-e1a6-49a2-849e-f6b9f5d312c0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:11.632738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d9403f69-e1a6-49a2-849e-f6b9f5d312c0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:11.633233 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d9403f69-e1a6-49a2-849e-f6b9f5d312c0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:11.767292 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d9403f69-e1a6-49a2-849e-f6b9f5d312c0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:11.775827 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d9403f69-e1a6-49a2-849e-f6b9f5d312c0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.157890 Apr 12 15:16:11.776406 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 683/1390] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:11 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:12.794286 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d32ee9d3-c8ad-4149-9d32-bfb9e4fdad02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:12.794857 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d32ee9d3-c8ad-4149-9d32-bfb9e4fdad02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:12.803724 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d32ee9d3-c8ad-4149-9d32-bfb9e4fdad02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:12.804181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d32ee9d3-c8ad-4149-9d32-bfb9e4fdad02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:12.805066 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d32ee9d3-c8ad-4149-9d32-bfb9e4fdad02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:12.805581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d32ee9d3-c8ad-4149-9d32-bfb9e4fdad02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:12.942554 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d32ee9d3-c8ad-4149-9d32-bfb9e4fdad02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:12.950501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d32ee9d3-c8ad-4149-9d32-bfb9e4fdad02 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.160545 Apr 12 15:16:12.951085 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 708/1391] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:12 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:13.968257 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b2a3117e-d171-4085-8df4-8a0a26a7f44f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:13.968846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b2a3117e-d171-4085-8df4-8a0a26a7f44f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:13.976114 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b2a3117e-d171-4085-8df4-8a0a26a7f44f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:13.976554 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b2a3117e-d171-4085-8df4-8a0a26a7f44f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:13.977322 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b2a3117e-d171-4085-8df4-8a0a26a7f44f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:13.977796 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b2a3117e-d171-4085-8df4-8a0a26a7f44f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:14.115099 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b2a3117e-d171-4085-8df4-8a0a26a7f44f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:14.123503 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b2a3117e-d171-4085-8df4-8a0a26a7f44f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.159051 Apr 12 15:16:14.124070 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 684/1392] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:13 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:15.141564 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9f0233e5-6d44-4dee-bd23-67b10b77dfde tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:15.142302 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9f0233e5-6d44-4dee-bd23-67b10b77dfde tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:15.149340 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0233e5-6d44-4dee-bd23-67b10b77dfde tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:15.149826 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0233e5-6d44-4dee-bd23-67b10b77dfde tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:15.150594 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0233e5-6d44-4dee-bd23-67b10b77dfde tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:15.151021 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f0233e5-6d44-4dee-bd23-67b10b77dfde tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:15.282090 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9f0233e5-6d44-4dee-bd23-67b10b77dfde tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:15.290969 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9f0233e5-6d44-4dee-bd23-67b10b77dfde tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.153092 Apr 12 15:16:15.291465 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 709/1393] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:15 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:16.308968 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-80444b75-49e8-4714-972c-1721c3c88c09 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:16.309580 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-80444b75-49e8-4714-972c-1721c3c88c09 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:16.316110 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80444b75-49e8-4714-972c-1721c3c88c09 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:16.316560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80444b75-49e8-4714-972c-1721c3c88c09 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:16.317352 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80444b75-49e8-4714-972c-1721c3c88c09 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:16.317823 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-80444b75-49e8-4714-972c-1721c3c88c09 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:16.453125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-80444b75-49e8-4714-972c-1721c3c88c09 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:16.466987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-80444b75-49e8-4714-972c-1721c3c88c09 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.162535 Apr 12 15:16:16.467586 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 685/1394] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:16 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:17.485187 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1da30591-ba21-49de-9ffa-5c1437559740 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:17.485788 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1da30591-ba21-49de-9ffa-5c1437559740 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:17.492749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1da30591-ba21-49de-9ffa-5c1437559740 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:17.493203 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1da30591-ba21-49de-9ffa-5c1437559740 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:17.494086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1da30591-ba21-49de-9ffa-5c1437559740 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:17.494528 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1da30591-ba21-49de-9ffa-5c1437559740 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:17.629569 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1da30591-ba21-49de-9ffa-5c1437559740 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:17.638472 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1da30591-ba21-49de-9ffa-5c1437559740 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.157239 Apr 12 15:16:17.639040 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 710/1395] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:17 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:18.656363 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4e670bf3-9882-476a-8b41-982eb3b1227e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:18.657040 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4e670bf3-9882-476a-8b41-982eb3b1227e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:18.663751 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e670bf3-9882-476a-8b41-982eb3b1227e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:18.664198 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e670bf3-9882-476a-8b41-982eb3b1227e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:18.664961 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e670bf3-9882-476a-8b41-982eb3b1227e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:18.665664 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e670bf3-9882-476a-8b41-982eb3b1227e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:18.792842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4e670bf3-9882-476a-8b41-982eb3b1227e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:18.801892 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4e670bf3-9882-476a-8b41-982eb3b1227e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.149400 Apr 12 15:16:18.802599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 686/1396] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:18 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:19.819874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-69983d9a-cc6a-4c88-a3f3-1e5e6c2557cd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:19.820605 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-69983d9a-cc6a-4c88-a3f3-1e5e6c2557cd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:19.826822 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69983d9a-cc6a-4c88-a3f3-1e5e6c2557cd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:19.827261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69983d9a-cc6a-4c88-a3f3-1e5e6c2557cd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:19.828015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69983d9a-cc6a-4c88-a3f3-1e5e6c2557cd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:19.828442 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69983d9a-cc6a-4c88-a3f3-1e5e6c2557cd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:19.963226 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-69983d9a-cc6a-4c88-a3f3-1e5e6c2557cd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:19.971138 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-69983d9a-cc6a-4c88-a3f3-1e5e6c2557cd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.155234 Apr 12 15:16:19.971745 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 711/1397] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:19 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:20.988725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-68e24d4e-c3bf-4a7b-a99b-361124e89def tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:20.989363 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-68e24d4e-c3bf-4a7b-a99b-361124e89def tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:20.996694 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-68e24d4e-c3bf-4a7b-a99b-361124e89def tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:20.997207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-68e24d4e-c3bf-4a7b-a99b-361124e89def tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:20.998026 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-68e24d4e-c3bf-4a7b-a99b-361124e89def tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:20.998462 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-68e24d4e-c3bf-4a7b-a99b-361124e89def tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:21.135381 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-68e24d4e-c3bf-4a7b-a99b-361124e89def tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:21.148664 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-68e24d4e-c3bf-4a7b-a99b-361124e89def tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.163778 Apr 12 15:16:21.149481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 687/1398] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:20 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:22.166518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9a5faa4f-99e1-4dbd-ade5-9c0fa9b5387d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:22.167140 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9a5faa4f-99e1-4dbd-ade5-9c0fa9b5387d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:22.173124 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a5faa4f-99e1-4dbd-ade5-9c0fa9b5387d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:22.173505 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a5faa4f-99e1-4dbd-ade5-9c0fa9b5387d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:22.174294 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a5faa4f-99e1-4dbd-ade5-9c0fa9b5387d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:22.174720 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a5faa4f-99e1-4dbd-ade5-9c0fa9b5387d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:22.305974 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9a5faa4f-99e1-4dbd-ade5-9c0fa9b5387d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:22.314109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9a5faa4f-99e1-4dbd-ade5-9c0fa9b5387d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.151789 Apr 12 15:16:22.314706 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 712/1399] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:22 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:23.331290 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6c2e62c1-39ae-4dd7-85e4-f5266cefad54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:23.331935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6c2e62c1-39ae-4dd7-85e4-f5266cefad54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:23.338945 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c2e62c1-39ae-4dd7-85e4-f5266cefad54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:23.339391 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c2e62c1-39ae-4dd7-85e4-f5266cefad54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:23.340162 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c2e62c1-39ae-4dd7-85e4-f5266cefad54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:23.340591 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6c2e62c1-39ae-4dd7-85e4-f5266cefad54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:23.480990 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6c2e62c1-39ae-4dd7-85e4-f5266cefad54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:23.489171 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6c2e62c1-39ae-4dd7-85e4-f5266cefad54 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.161669 Apr 12 15:16:23.489781 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 688/1400] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:23 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:24.507285 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-67cbb4bf-344e-4ab3-8203-f4a3e4006d01 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:24.512922 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-67cbb4bf-344e-4ab3-8203-f4a3e4006d01 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:24.514784 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67cbb4bf-344e-4ab3-8203-f4a3e4006d01 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:24.515242 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67cbb4bf-344e-4ab3-8203-f4a3e4006d01 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:24.516045 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67cbb4bf-344e-4ab3-8203-f4a3e4006d01 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:24.516492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-67cbb4bf-344e-4ab3-8203-f4a3e4006d01 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:24.656672 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-67cbb4bf-344e-4ab3-8203-f4a3e4006d01 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:24.666049 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-67cbb4bf-344e-4ab3-8203-f4a3e4006d01 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.163567 Apr 12 15:16:24.666680 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 713/1401] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:24 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:25.682683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-156f0438-3b61-421f-a2c0-146d1f8d4be4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:25.683278 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-156f0438-3b61-421f-a2c0-146d1f8d4be4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:25.690175 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-156f0438-3b61-421f-a2c0-146d1f8d4be4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:25.690649 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-156f0438-3b61-421f-a2c0-146d1f8d4be4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:25.691417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-156f0438-3b61-421f-a2c0-146d1f8d4be4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:25.691853 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-156f0438-3b61-421f-a2c0-146d1f8d4be4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:25.823329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-156f0438-3b61-421f-a2c0-146d1f8d4be4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:25.831418 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-156f0438-3b61-421f-a2c0-146d1f8d4be4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152662 Apr 12 15:16:25.832281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 689/1402] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:25 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:26.850161 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e7c9d95d-86db-4bdb-b6de-a41c87475314 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:26.850726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e7c9d95d-86db-4bdb-b6de-a41c87475314 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:26.857472 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7c9d95d-86db-4bdb-b6de-a41c87475314 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:26.857948 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7c9d95d-86db-4bdb-b6de-a41c87475314 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:26.858723 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7c9d95d-86db-4bdb-b6de-a41c87475314 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:26.859157 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e7c9d95d-86db-4bdb-b6de-a41c87475314 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:26.988943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e7c9d95d-86db-4bdb-b6de-a41c87475314 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:26.997495 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e7c9d95d-86db-4bdb-b6de-a41c87475314 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.151534 Apr 12 15:16:26.998121 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 714/1403] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:26 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:16:28.016501 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e8f3a043-9619-4c9c-a27e-977083078885 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:28.017073 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e8f3a043-9619-4c9c-a27e-977083078885 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:28.024043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e8f3a043-9619-4c9c-a27e-977083078885 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:28.024480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e8f3a043-9619-4c9c-a27e-977083078885 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:28.025249 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e8f3a043-9619-4c9c-a27e-977083078885 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:28.025695 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e8f3a043-9619-4c9c-a27e-977083078885 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:28.166231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e8f3a043-9619-4c9c-a27e-977083078885 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:28.179744 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e8f3a043-9619-4c9c-a27e-977083078885 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.167677 Apr 12 15:16:28.180629 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 690/1404] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:28 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:29.197897 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3dd03f55-2239-4ebd-ad12-b48bb8e2ab82 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:29.198460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3dd03f55-2239-4ebd-ad12-b48bb8e2ab82 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:29.204821 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3dd03f55-2239-4ebd-ad12-b48bb8e2ab82 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:29.205300 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3dd03f55-2239-4ebd-ad12-b48bb8e2ab82 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:29.206085 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3dd03f55-2239-4ebd-ad12-b48bb8e2ab82 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:29.206519 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3dd03f55-2239-4ebd-ad12-b48bb8e2ab82 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:29.355916 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3dd03f55-2239-4ebd-ad12-b48bb8e2ab82 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:29.363769 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3dd03f55-2239-4ebd-ad12-b48bb8e2ab82 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.170017 Apr 12 15:16:29.364333 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 715/1405] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:29 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:30.381578 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-95b6dab1-c25c-4100-b2af-810442cd67a9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:30.382165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-95b6dab1-c25c-4100-b2af-810442cd67a9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:30.388557 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95b6dab1-c25c-4100-b2af-810442cd67a9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:30.388995 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95b6dab1-c25c-4100-b2af-810442cd67a9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:30.389787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95b6dab1-c25c-4100-b2af-810442cd67a9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:30.390243 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-95b6dab1-c25c-4100-b2af-810442cd67a9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:30.522491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-95b6dab1-c25c-4100-b2af-810442cd67a9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:30.530846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-95b6dab1-c25c-4100-b2af-810442cd67a9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.153712 Apr 12 15:16:30.531436 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 691/1406] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:30 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:31.548384 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-defa5c56-27e9-49ee-8d0f-e7f396d23a9d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:31.548997 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-defa5c56-27e9-49ee-8d0f-e7f396d23a9d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:31.556506 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-defa5c56-27e9-49ee-8d0f-e7f396d23a9d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:31.556955 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-defa5c56-27e9-49ee-8d0f-e7f396d23a9d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:31.557769 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-defa5c56-27e9-49ee-8d0f-e7f396d23a9d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:31.558207 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-defa5c56-27e9-49ee-8d0f-e7f396d23a9d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:31.695100 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-defa5c56-27e9-49ee-8d0f-e7f396d23a9d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:31.703133 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-defa5c56-27e9-49ee-8d0f-e7f396d23a9d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.158563 Apr 12 15:16:31.703707 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 716/1407] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:31 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:16:32.720839 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-48e81464-9b25-4c4d-aa5f-ef3c156a3be8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:32.721464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-48e81464-9b25-4c4d-aa5f-ef3c156a3be8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:32.729072 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-48e81464-9b25-4c4d-aa5f-ef3c156a3be8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:32.729519 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-48e81464-9b25-4c4d-aa5f-ef3c156a3be8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:32.730315 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-48e81464-9b25-4c4d-aa5f-ef3c156a3be8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:32.730738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-48e81464-9b25-4c4d-aa5f-ef3c156a3be8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:32.862872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-48e81464-9b25-4c4d-aa5f-ef3c156a3be8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:32.872318 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-48e81464-9b25-4c4d-aa5f-ef3c156a3be8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.155370 Apr 12 15:16:32.872941 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 692/1408] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:32 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:33.891287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2b64d16f-6845-4205-ad04-49f8c99a3d47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:33.891876 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2b64d16f-6845-4205-ad04-49f8c99a3d47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:33.898544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b64d16f-6845-4205-ad04-49f8c99a3d47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:33.898988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b64d16f-6845-4205-ad04-49f8c99a3d47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:33.899755 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b64d16f-6845-4205-ad04-49f8c99a3d47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:33.900176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2b64d16f-6845-4205-ad04-49f8c99a3d47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:34.058838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2b64d16f-6845-4205-ad04-49f8c99a3d47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:34.068126 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2b64d16f-6845-4205-ad04-49f8c99a3d47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.180701 Apr 12 15:16:34.069359 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 717/1409] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:33 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:16:35.086256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b5d10c61-2228-4614-9bdd-352addd6332d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:35.086863 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b5d10c61-2228-4614-9bdd-352addd6332d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:35.093456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b5d10c61-2228-4614-9bdd-352addd6332d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:35.094035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b5d10c61-2228-4614-9bdd-352addd6332d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:35.094815 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b5d10c61-2228-4614-9bdd-352addd6332d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:35.095287 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b5d10c61-2228-4614-9bdd-352addd6332d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:35.234870 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b5d10c61-2228-4614-9bdd-352addd6332d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:35.243752 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b5d10c61-2228-4614-9bdd-352addd6332d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.162044 Apr 12 15:16:35.244329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 693/1410] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:35 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:36.261975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-33db1212-3813-4c62-8335-cb500294b76f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:36.262580 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-33db1212-3813-4c62-8335-cb500294b76f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:36.269071 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-33db1212-3813-4c62-8335-cb500294b76f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:36.269511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-33db1212-3813-4c62-8335-cb500294b76f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:36.270392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-33db1212-3813-4c62-8335-cb500294b76f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:36.271636 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-33db1212-3813-4c62-8335-cb500294b76f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:36.410463 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-33db1212-3813-4c62-8335-cb500294b76f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:36.419139 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-33db1212-3813-4c62-8335-cb500294b76f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.161099 Apr 12 15:16:36.419699 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 718/1411] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:36 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:37.435930 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8bb0f811-5d87-41a8-8d6f-ca09e5660396 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:37.436510 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8bb0f811-5d87-41a8-8d6f-ca09e5660396 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:37.444064 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bb0f811-5d87-41a8-8d6f-ca09e5660396 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:37.444507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bb0f811-5d87-41a8-8d6f-ca09e5660396 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:37.445268 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bb0f811-5d87-41a8-8d6f-ca09e5660396 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:37.445725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8bb0f811-5d87-41a8-8d6f-ca09e5660396 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:37.577306 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8bb0f811-5d87-41a8-8d6f-ca09e5660396 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:37.585167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8bb0f811-5d87-41a8-8d6f-ca09e5660396 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.153196 Apr 12 15:16:37.585741 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 694/1412] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:37 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:38.602623 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4ce793bc-ff66-4d4f-9f41-cc2bab94dc8f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:38.603231 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4ce793bc-ff66-4d4f-9f41-cc2bab94dc8f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:38.611815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ce793bc-ff66-4d4f-9f41-cc2bab94dc8f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:38.611815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ce793bc-ff66-4d4f-9f41-cc2bab94dc8f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:38.611815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ce793bc-ff66-4d4f-9f41-cc2bab94dc8f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:38.612118 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4ce793bc-ff66-4d4f-9f41-cc2bab94dc8f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:38.741868 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4ce793bc-ff66-4d4f-9f41-cc2bab94dc8f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:38.749681 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4ce793bc-ff66-4d4f-9f41-cc2bab94dc8f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.151252 Apr 12 15:16:38.750245 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 719/1413] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:38 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:39.767275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3c439bd5-7cde-4968-8ff0-194e4f8955e0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:39.767912 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3c439bd5-7cde-4968-8ff0-194e4f8955e0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:39.775375 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3c439bd5-7cde-4968-8ff0-194e4f8955e0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:39.775820 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3c439bd5-7cde-4968-8ff0-194e4f8955e0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:39.776574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3c439bd5-7cde-4968-8ff0-194e4f8955e0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:39.776998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3c439bd5-7cde-4968-8ff0-194e4f8955e0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:39.905178 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3c439bd5-7cde-4968-8ff0-194e4f8955e0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:39.913891 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3c439bd5-7cde-4968-8ff0-194e4f8955e0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150420 Apr 12 15:16:39.914765 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 695/1414] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:39 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:40.931961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f41fc6c6-8b40-435a-ba89-bf277ca228f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:40.932561 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f41fc6c6-8b40-435a-ba89-bf277ca228f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:40.938797 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f41fc6c6-8b40-435a-ba89-bf277ca228f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:40.939245 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f41fc6c6-8b40-435a-ba89-bf277ca228f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:40.939997 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f41fc6c6-8b40-435a-ba89-bf277ca228f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:40.940420 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f41fc6c6-8b40-435a-ba89-bf277ca228f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:41.065377 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f41fc6c6-8b40-435a-ba89-bf277ca228f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:41.074082 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f41fc6c6-8b40-435a-ba89-bf277ca228f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.146551 Apr 12 15:16:41.074658 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 720/1415] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:40 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:42.095704 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-864fe20b-9a14-4dea-abc3-75342abc5b4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:42.096481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-864fe20b-9a14-4dea-abc3-75342abc5b4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:42.105172 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-864fe20b-9a14-4dea-abc3-75342abc5b4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:42.105643 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-864fe20b-9a14-4dea-abc3-75342abc5b4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:42.106428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-864fe20b-9a14-4dea-abc3-75342abc5b4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:42.106863 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-864fe20b-9a14-4dea-abc3-75342abc5b4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:42.252705 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-864fe20b-9a14-4dea-abc3-75342abc5b4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:42.262045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-864fe20b-9a14-4dea-abc3-75342abc5b4e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.173081 Apr 12 15:16:42.262625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 696/1416] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:42 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:43.279494 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fa47912e-640b-4d30-9c66-7430a40f8334 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:43.280087 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fa47912e-640b-4d30-9c66-7430a40f8334 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:43.286392 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fa47912e-640b-4d30-9c66-7430a40f8334 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:43.286839 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fa47912e-640b-4d30-9c66-7430a40f8334 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:43.287809 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fa47912e-640b-4d30-9c66-7430a40f8334 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:43.288242 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fa47912e-640b-4d30-9c66-7430a40f8334 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:43.420207 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fa47912e-640b-4d30-9c66-7430a40f8334 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:43.428445 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fa47912e-640b-4d30-9c66-7430a40f8334 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152291 Apr 12 15:16:43.429080 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 721/1417] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:43 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:44.446283 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-433f0031-ff22-4990-a3a1-54a2d0aee3c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:44.446894 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-433f0031-ff22-4990-a3a1-54a2d0aee3c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:44.453431 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-433f0031-ff22-4990-a3a1-54a2d0aee3c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:44.453907 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-433f0031-ff22-4990-a3a1-54a2d0aee3c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:44.454718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-433f0031-ff22-4990-a3a1-54a2d0aee3c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:44.455152 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-433f0031-ff22-4990-a3a1-54a2d0aee3c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:44.583292 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-433f0031-ff22-4990-a3a1-54a2d0aee3c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:44.591259 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-433f0031-ff22-4990-a3a1-54a2d0aee3c5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.149383 Apr 12 15:16:44.591842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 697/1418] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:44 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:45.610597 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f5e91d6c-08f8-472e-aca6-267b394b3ce7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:45.611319 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f5e91d6c-08f8-472e-aca6-267b394b3ce7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:45.617970 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5e91d6c-08f8-472e-aca6-267b394b3ce7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:45.618417 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5e91d6c-08f8-472e-aca6-267b394b3ce7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:45.619410 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5e91d6c-08f8-472e-aca6-267b394b3ce7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:45.619843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5e91d6c-08f8-472e-aca6-267b394b3ce7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:45.755673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f5e91d6c-08f8-472e-aca6-267b394b3ce7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:45.764785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f5e91d6c-08f8-472e-aca6-267b394b3ce7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.159013 Apr 12 15:16:45.765364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 722/1419] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:45 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:46.782327 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1b64b3ad-15b1-415a-bccf-0adcae75cbdd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:46.782881 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1b64b3ad-15b1-415a-bccf-0adcae75cbdd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:46.789774 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1b64b3ad-15b1-415a-bccf-0adcae75cbdd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:46.790217 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1b64b3ad-15b1-415a-bccf-0adcae75cbdd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:46.791046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1b64b3ad-15b1-415a-bccf-0adcae75cbdd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:46.791471 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1b64b3ad-15b1-415a-bccf-0adcae75cbdd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:46.920700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1b64b3ad-15b1-415a-bccf-0adcae75cbdd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:46.928466 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1b64b3ad-15b1-415a-bccf-0adcae75cbdd tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150244 Apr 12 15:16:46.929775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 698/1420] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:46 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:47.946549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-114c9adf-78f7-4deb-8327-01360560e184 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:47.947922 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-114c9adf-78f7-4deb-8327-01360560e184 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:47.954326 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-114c9adf-78f7-4deb-8327-01360560e184 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:47.954788 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-114c9adf-78f7-4deb-8327-01360560e184 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:47.955539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-114c9adf-78f7-4deb-8327-01360560e184 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:47.955963 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-114c9adf-78f7-4deb-8327-01360560e184 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:48.086425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-114c9adf-78f7-4deb-8327-01360560e184 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:48.094296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-114c9adf-78f7-4deb-8327-01360560e184 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.151632 Apr 12 15:16:48.094852 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 723/1421] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:47 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:49.112526 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-efe09833-6fdb-4bae-9c11-453983c07f99 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:49.113100 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-efe09833-6fdb-4bae-9c11-453983c07f99 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:49.119208 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efe09833-6fdb-4bae-9c11-453983c07f99 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:49.119642 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efe09833-6fdb-4bae-9c11-453983c07f99 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:49.120403 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efe09833-6fdb-4bae-9c11-453983c07f99 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:49.120834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-efe09833-6fdb-4bae-9c11-453983c07f99 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:49.250236 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-efe09833-6fdb-4bae-9c11-453983c07f99 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:49.258482 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-efe09833-6fdb-4bae-9c11-453983c07f99 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150088 Apr 12 15:16:49.259053 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 699/1422] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:49 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:50.275898 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c76ed20d-5925-44a8-8374-13bf0b711db7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:50.276502 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c76ed20d-5925-44a8-8374-13bf0b711db7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:50.282560 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c76ed20d-5925-44a8-8374-13bf0b711db7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:50.283009 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c76ed20d-5925-44a8-8374-13bf0b711db7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:50.283773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c76ed20d-5925-44a8-8374-13bf0b711db7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:50.284204 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c76ed20d-5925-44a8-8374-13bf0b711db7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:50.408976 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c76ed20d-5925-44a8-8374-13bf0b711db7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:50.417332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c76ed20d-5925-44a8-8374-13bf0b711db7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.145880 Apr 12 15:16:50.417932 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 724/1423] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:50 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:51.434403 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dccbe7e2-af20-499d-9be0-cb4319edbf75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:51.435025 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dccbe7e2-af20-499d-9be0-cb4319edbf75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:51.447291 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dccbe7e2-af20-499d-9be0-cb4319edbf75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:51.448091 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dccbe7e2-af20-499d-9be0-cb4319edbf75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:51.449478 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dccbe7e2-af20-499d-9be0-cb4319edbf75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:51.450325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dccbe7e2-af20-499d-9be0-cb4319edbf75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:51.583896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dccbe7e2-af20-499d-9be0-cb4319edbf75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:51.592589 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dccbe7e2-af20-499d-9be0-cb4319edbf75 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.162023 Apr 12 15:16:51.593163 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 700/1424] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:51 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:52.610529 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c2d3743e-af0e-496d-adcd-fb2582e65741 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:52.611131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c2d3743e-af0e-496d-adcd-fb2582e65741 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:52.618094 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2d3743e-af0e-496d-adcd-fb2582e65741 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:52.618538 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2d3743e-af0e-496d-adcd-fb2582e65741 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:52.619316 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2d3743e-af0e-496d-adcd-fb2582e65741 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:52.619740 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c2d3743e-af0e-496d-adcd-fb2582e65741 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:52.756114 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c2d3743e-af0e-496d-adcd-fb2582e65741 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:52.764926 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c2d3743e-af0e-496d-adcd-fb2582e65741 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.158269 Apr 12 15:16:52.765568 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 725/1425] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:52 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:53.782701 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-832c0ac4-3b88-48bd-a51f-7905836ebad0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:53.783329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-832c0ac4-3b88-48bd-a51f-7905836ebad0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:53.790751 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-832c0ac4-3b88-48bd-a51f-7905836ebad0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:53.791201 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-832c0ac4-3b88-48bd-a51f-7905836ebad0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:53.791982 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-832c0ac4-3b88-48bd-a51f-7905836ebad0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:53.792411 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-832c0ac4-3b88-48bd-a51f-7905836ebad0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:53.927542 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-832c0ac4-3b88-48bd-a51f-7905836ebad0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:53.935893 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-832c0ac4-3b88-48bd-a51f-7905836ebad0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.157098 Apr 12 15:16:53.936468 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 701/1426] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:53 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:54.953862 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-309fb439-6c5f-4b54-bd78-d3caf75cee0c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:54.954555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-309fb439-6c5f-4b54-bd78-d3caf75cee0c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:54.962416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-309fb439-6c5f-4b54-bd78-d3caf75cee0c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:54.962864 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-309fb439-6c5f-4b54-bd78-d3caf75cee0c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:54.963642 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-309fb439-6c5f-4b54-bd78-d3caf75cee0c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:54.964067 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-309fb439-6c5f-4b54-bd78-d3caf75cee0c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:55.125304 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-309fb439-6c5f-4b54-bd78-d3caf75cee0c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:55.135470 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-309fb439-6c5f-4b54-bd78-d3caf75cee0c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.185779 Apr 12 15:16:55.136074 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 726/1427] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:54 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:56.152694 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e1a21e51-8a1f-4fb7-8fc0-0aba8246e93e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:56.153327 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e1a21e51-8a1f-4fb7-8fc0-0aba8246e93e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:56.159759 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e1a21e51-8a1f-4fb7-8fc0-0aba8246e93e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:56.160231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e1a21e51-8a1f-4fb7-8fc0-0aba8246e93e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:56.160996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e1a21e51-8a1f-4fb7-8fc0-0aba8246e93e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:56.161425 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e1a21e51-8a1f-4fb7-8fc0-0aba8246e93e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:56.306775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e1a21e51-8a1f-4fb7-8fc0-0aba8246e93e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:56.317216 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e1a21e51-8a1f-4fb7-8fc0-0aba8246e93e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.168747 Apr 12 15:16:56.324499 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 702/1428] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:56 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:57.340430 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-95f75afb-bd3c-4861-a739-69de4ba647d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:57.341205 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-95f75afb-bd3c-4861-a739-69de4ba647d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:57.347868 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-95f75afb-bd3c-4861-a739-69de4ba647d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:57.348314 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-95f75afb-bd3c-4861-a739-69de4ba647d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:57.349101 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-95f75afb-bd3c-4861-a739-69de4ba647d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:57.349529 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-95f75afb-bd3c-4861-a739-69de4ba647d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:57.475818 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-95f75afb-bd3c-4861-a739-69de4ba647d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:57.484175 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-95f75afb-bd3c-4861-a739-69de4ba647d8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.147796 Apr 12 15:16:57.484739 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 727/1429] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:57 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:58.502716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c545cbe3-5a3d-42f1-a721-fa4ed6fdecf6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:58.503285 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c545cbe3-5a3d-42f1-a721-fa4ed6fdecf6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:58.510840 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c545cbe3-5a3d-42f1-a721-fa4ed6fdecf6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:58.511363 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c545cbe3-5a3d-42f1-a721-fa4ed6fdecf6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:58.512149 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c545cbe3-5a3d-42f1-a721-fa4ed6fdecf6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:58.512739 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c545cbe3-5a3d-42f1-a721-fa4ed6fdecf6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:58.643882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c545cbe3-5a3d-42f1-a721-fa4ed6fdecf6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:58.652859 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c545cbe3-5a3d-42f1-a721-fa4ed6fdecf6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154208 Apr 12 15:16:58.653451 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 703/1430] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:58 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:16:59.670380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-effa6397-5c73-4787-bec6-1c53ac52773e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:16:59.670948 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-effa6397-5c73-4787-bec6-1c53ac52773e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:16:59.677549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-effa6397-5c73-4787-bec6-1c53ac52773e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:59.678024 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-effa6397-5c73-4787-bec6-1c53ac52773e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:59.678789 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-effa6397-5c73-4787-bec6-1c53ac52773e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:16:59.679221 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-effa6397-5c73-4787-bec6-1c53ac52773e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:16:59.829921 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-effa6397-5c73-4787-bec6-1c53ac52773e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:16:59.838371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-effa6397-5c73-4787-bec6-1c53ac52773e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.171902 Apr 12 15:16:59.838944 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 728/1431] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:16:59 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:00.856360 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-62060c8a-b381-4ecc-92fc-a67d8e33dc0b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:00.856954 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-62060c8a-b381-4ecc-92fc-a67d8e33dc0b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:00.863360 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62060c8a-b381-4ecc-92fc-a67d8e33dc0b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:00.863817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62060c8a-b381-4ecc-92fc-a67d8e33dc0b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:00.864601 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62060c8a-b381-4ecc-92fc-a67d8e33dc0b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:00.865035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-62060c8a-b381-4ecc-92fc-a67d8e33dc0b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:00.996769 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-62060c8a-b381-4ecc-92fc-a67d8e33dc0b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:01.004552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-62060c8a-b381-4ecc-92fc-a67d8e33dc0b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152691 Apr 12 15:17:01.005124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 704/1432] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:00 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:02.022656 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-dfe24000-b9f7-48ba-9c5c-b0c71b10f51f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:02.023264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-dfe24000-b9f7-48ba-9c5c-b0c71b10f51f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:02.031084 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dfe24000-b9f7-48ba-9c5c-b0c71b10f51f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:02.031524 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dfe24000-b9f7-48ba-9c5c-b0c71b10f51f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:02.032287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dfe24000-b9f7-48ba-9c5c-b0c71b10f51f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:02.032743 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-dfe24000-b9f7-48ba-9c5c-b0c71b10f51f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:02.172204 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-dfe24000-b9f7-48ba-9c5c-b0c71b10f51f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:02.180332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-dfe24000-b9f7-48ba-9c5c-b0c71b10f51f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.161355 Apr 12 15:17:02.180906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 729/1433] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:02 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:03.198214 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-301d0ddc-dd62-4170-a4e4-d622cff2f5a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:03.198837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-301d0ddc-dd62-4170-a4e4-d622cff2f5a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:03.205675 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-301d0ddc-dd62-4170-a4e4-d622cff2f5a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:03.205946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-301d0ddc-dd62-4170-a4e4-d622cff2f5a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:03.206778 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-301d0ddc-dd62-4170-a4e4-d622cff2f5a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:03.207117 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-301d0ddc-dd62-4170-a4e4-d622cff2f5a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:03.340223 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-301d0ddc-dd62-4170-a4e4-d622cff2f5a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:03.348398 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-301d0ddc-dd62-4170-a4e4-d622cff2f5a0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154691 Apr 12 15:17:03.348999 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 705/1434] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:03 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:04.366758 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7346d260-eca4-4e09-bc36-81757e5fc5a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:04.367467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7346d260-eca4-4e09-bc36-81757e5fc5a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:04.374697 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7346d260-eca4-4e09-bc36-81757e5fc5a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:04.375137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7346d260-eca4-4e09-bc36-81757e5fc5a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:04.375898 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7346d260-eca4-4e09-bc36-81757e5fc5a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:04.376328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7346d260-eca4-4e09-bc36-81757e5fc5a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:04.502965 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7346d260-eca4-4e09-bc36-81757e5fc5a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:04.510730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7346d260-eca4-4e09-bc36-81757e5fc5a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.147862 Apr 12 15:17:04.511433 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 730/1435] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:04 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:05.530720 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-be3c973d-3acd-414c-84e7-dbeb99aea865 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:05.531785 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-be3c973d-3acd-414c-84e7-dbeb99aea865 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:05.539574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-be3c973d-3acd-414c-84e7-dbeb99aea865 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:05.540317 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-be3c973d-3acd-414c-84e7-dbeb99aea865 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:05.541095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-be3c973d-3acd-414c-84e7-dbeb99aea865 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:05.541525 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-be3c973d-3acd-414c-84e7-dbeb99aea865 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:05.687167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-be3c973d-3acd-414c-84e7-dbeb99aea865 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:05.695169 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-be3c973d-3acd-414c-84e7-dbeb99aea865 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.171134 Apr 12 15:17:05.696536 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 706/1436] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:05 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:06.714143 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c55ab4b6-2e35-4884-9ad7-e0c9710eddb8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:06.714913 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c55ab4b6-2e35-4884-9ad7-e0c9710eddb8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:06.725026 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c55ab4b6-2e35-4884-9ad7-e0c9710eddb8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:06.725811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c55ab4b6-2e35-4884-9ad7-e0c9710eddb8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:06.727611 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c55ab4b6-2e35-4884-9ad7-e0c9710eddb8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:06.728326 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c55ab4b6-2e35-4884-9ad7-e0c9710eddb8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:06.884960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c55ab4b6-2e35-4884-9ad7-e0c9710eddb8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:06.896086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c55ab4b6-2e35-4884-9ad7-e0c9710eddb8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.186498 Apr 12 15:17:06.896674 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 731/1437] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:06 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:07.916107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b6677fc6-6160-468a-b980-feeb82746bf8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:07.916674 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b6677fc6-6160-468a-b980-feeb82746bf8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:07.926700 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b6677fc6-6160-468a-b980-feeb82746bf8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:07.927446 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b6677fc6-6160-468a-b980-feeb82746bf8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:07.928817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b6677fc6-6160-468a-b980-feeb82746bf8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:07.929834 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b6677fc6-6160-468a-b980-feeb82746bf8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:08.076594 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b6677fc6-6160-468a-b980-feeb82746bf8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:08.085109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b6677fc6-6160-468a-b980-feeb82746bf8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.173257 Apr 12 15:17:08.085721 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 707/1438] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:07 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:09.103415 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b10e2fbc-a32b-4348-9c24-1112395bf5e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:09.104021 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b10e2fbc-a32b-4348-9c24-1112395bf5e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:09.110344 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b10e2fbc-a32b-4348-9c24-1112395bf5e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:09.110782 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b10e2fbc-a32b-4348-9c24-1112395bf5e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:09.111541 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b10e2fbc-a32b-4348-9c24-1112395bf5e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:09.111966 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b10e2fbc-a32b-4348-9c24-1112395bf5e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:09.245601 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b10e2fbc-a32b-4348-9c24-1112395bf5e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:09.253541 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b10e2fbc-a32b-4348-9c24-1112395bf5e6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154541 Apr 12 15:17:09.254136 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 732/1439] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:09 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:10.270935 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-67a03928-801b-44c1-ab7a-0c43b72c0856 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:10.271543 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-67a03928-801b-44c1-ab7a-0c43b72c0856 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:10.278407 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-67a03928-801b-44c1-ab7a-0c43b72c0856 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:10.278856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-67a03928-801b-44c1-ab7a-0c43b72c0856 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:10.279638 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-67a03928-801b-44c1-ab7a-0c43b72c0856 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:10.280071 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-67a03928-801b-44c1-ab7a-0c43b72c0856 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:10.413737 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-67a03928-801b-44c1-ab7a-0c43b72c0856 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:10.421896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-67a03928-801b-44c1-ab7a-0c43b72c0856 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154714 Apr 12 15:17:10.422680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 708/1440] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:10 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:11.440225 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-747b910e-5687-45ef-9203-b0c10e305558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:11.440897 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-747b910e-5687-45ef-9203-b0c10e305558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:11.448266 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-747b910e-5687-45ef-9203-b0c10e305558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:11.448717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-747b910e-5687-45ef-9203-b0c10e305558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:11.449494 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-747b910e-5687-45ef-9203-b0c10e305558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:11.449964 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-747b910e-5687-45ef-9203-b0c10e305558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:11.580656 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-747b910e-5687-45ef-9203-b0c10e305558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:11.588857 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-747b910e-5687-45ef-9203-b0c10e305558 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152391 Apr 12 15:17:11.589396 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 733/1441] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:11 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:12.614130 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ae92adaa-13c1-480c-bb7b-affb00b23c87 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:12.614772 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ae92adaa-13c1-480c-bb7b-affb00b23c87 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:12.621526 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae92adaa-13c1-480c-bb7b-affb00b23c87 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:12.622041 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae92adaa-13c1-480c-bb7b-affb00b23c87 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:12.622818 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae92adaa-13c1-480c-bb7b-affb00b23c87 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:12.623249 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae92adaa-13c1-480c-bb7b-affb00b23c87 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:12.756265 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ae92adaa-13c1-480c-bb7b-affb00b23c87 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:12.765136 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ae92adaa-13c1-480c-bb7b-affb00b23c87 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.155131 Apr 12 15:17:12.765767 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 709/1442] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:12 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:13.783871 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-456c3de2-9130-4415-a56b-da29f0889ce8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:13.784428 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-456c3de2-9130-4415-a56b-da29f0889ce8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:13.791321 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-456c3de2-9130-4415-a56b-da29f0889ce8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:13.791772 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-456c3de2-9130-4415-a56b-da29f0889ce8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:13.792552 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-456c3de2-9130-4415-a56b-da29f0889ce8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:13.792988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-456c3de2-9130-4415-a56b-da29f0889ce8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:13.930887 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-456c3de2-9130-4415-a56b-da29f0889ce8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:13.938884 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-456c3de2-9130-4415-a56b-da29f0889ce8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.158969 Apr 12 15:17:13.939468 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 734/1443] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:13 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:14.957107 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2f27da44-6fc5-42a8-8be6-0c8dbdf4ead8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:14.957697 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2f27da44-6fc5-42a8-8be6-0c8dbdf4ead8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:14.967422 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f27da44-6fc5-42a8-8be6-0c8dbdf4ead8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:14.967870 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f27da44-6fc5-42a8-8be6-0c8dbdf4ead8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:14.968653 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f27da44-6fc5-42a8-8be6-0c8dbdf4ead8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:14.969083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2f27da44-6fc5-42a8-8be6-0c8dbdf4ead8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:15.114820 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2f27da44-6fc5-42a8-8be6-0c8dbdf4ead8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:15.124397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2f27da44-6fc5-42a8-8be6-0c8dbdf4ead8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.171129 Apr 12 15:17:15.125338 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 710/1444] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:14 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:16.149349 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6b6ffa98-e76d-4361-8ccb-5ac9f33e0763 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:16.150025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6b6ffa98-e76d-4361-8ccb-5ac9f33e0763 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:16.156421 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b6ffa98-e76d-4361-8ccb-5ac9f33e0763 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:16.156865 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b6ffa98-e76d-4361-8ccb-5ac9f33e0763 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:16.157650 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b6ffa98-e76d-4361-8ccb-5ac9f33e0763 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:16.158095 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6b6ffa98-e76d-4361-8ccb-5ac9f33e0763 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:16.294170 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6b6ffa98-e76d-4361-8ccb-5ac9f33e0763 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:16.302403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6b6ffa98-e76d-4361-8ccb-5ac9f33e0763 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.156976 Apr 12 15:17:16.302983 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 735/1445] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:16 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:17.321257 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b19ae402-5a3b-44a6-a88b-ee25abb9155a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:17.322176 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b19ae402-5a3b-44a6-a88b-ee25abb9155a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:17.329862 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b19ae402-5a3b-44a6-a88b-ee25abb9155a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:17.330240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b19ae402-5a3b-44a6-a88b-ee25abb9155a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:17.331062 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b19ae402-5a3b-44a6-a88b-ee25abb9155a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:17.331488 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b19ae402-5a3b-44a6-a88b-ee25abb9155a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:17.465864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b19ae402-5a3b-44a6-a88b-ee25abb9155a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:17.474117 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b19ae402-5a3b-44a6-a88b-ee25abb9155a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.157358 Apr 12 15:17:17.474710 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 711/1446] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:17 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:18.491950 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-69b9fb3e-0f1e-407d-872f-f94b02e67788 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:18.492537 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-69b9fb3e-0f1e-407d-872f-f94b02e67788 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:18.499433 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69b9fb3e-0f1e-407d-872f-f94b02e67788 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:18.499875 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69b9fb3e-0f1e-407d-872f-f94b02e67788 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:18.501840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69b9fb3e-0f1e-407d-872f-f94b02e67788 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:18.501840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-69b9fb3e-0f1e-407d-872f-f94b02e67788 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:18.633854 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-69b9fb3e-0f1e-407d-872f-f94b02e67788 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:18.642854 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-69b9fb3e-0f1e-407d-872f-f94b02e67788 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154819 Apr 12 15:17:18.643431 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 736/1447] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:18 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:19.823687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6e9539b1-9268-4011-803b-6df2543ca7b3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:19.824296 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6e9539b1-9268-4011-803b-6df2543ca7b3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:19.830437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6e9539b1-9268-4011-803b-6df2543ca7b3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:19.830875 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6e9539b1-9268-4011-803b-6df2543ca7b3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:19.831641 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6e9539b1-9268-4011-803b-6df2543ca7b3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:19.832068 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6e9539b1-9268-4011-803b-6df2543ca7b3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:19.968364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6e9539b1-9268-4011-803b-6df2543ca7b3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:19.976763 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6e9539b1-9268-4011-803b-6df2543ca7b3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.319834 Apr 12 15:17:19.977940 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 712/1448] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:19 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:20.995451 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-1c7c71e6-afc8-46e4-a3fb-32eeac540a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:20.996062 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-1c7c71e6-afc8-46e4-a3fb-32eeac540a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:21.002063 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c7c71e6-afc8-46e4-a3fb-32eeac540a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:21.002512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c7c71e6-afc8-46e4-a3fb-32eeac540a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:21.003287 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c7c71e6-afc8-46e4-a3fb-32eeac540a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:21.003800 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-1c7c71e6-afc8-46e4-a3fb-32eeac540a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:21.141261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-1c7c71e6-afc8-46e4-a3fb-32eeac540a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:21.156738 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-1c7c71e6-afc8-46e4-a3fb-32eeac540a3a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.166062 Apr 12 15:17:21.157332 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 737/1449] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:20 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:22.180989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bf4ee229-e1bd-4e87-b87c-549660ee0776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:22.181622 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bf4ee229-e1bd-4e87-b87c-549660ee0776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:22.188157 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bf4ee229-e1bd-4e87-b87c-549660ee0776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:22.188587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bf4ee229-e1bd-4e87-b87c-549660ee0776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:22.189351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bf4ee229-e1bd-4e87-b87c-549660ee0776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:22.189824 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bf4ee229-e1bd-4e87-b87c-549660ee0776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:22.325521 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bf4ee229-e1bd-4e87-b87c-549660ee0776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:22.333661 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bf4ee229-e1bd-4e87-b87c-549660ee0776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.157036 Apr 12 15:17:22.334256 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 713/1450] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:22 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:23.356427 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6d39fbea-117d-46af-8121-b412fb9403f6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:23.357041 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6d39fbea-117d-46af-8121-b412fb9403f6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:23.363472 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d39fbea-117d-46af-8121-b412fb9403f6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:23.363915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d39fbea-117d-46af-8121-b412fb9403f6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:23.364687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d39fbea-117d-46af-8121-b412fb9403f6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:23.365116 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d39fbea-117d-46af-8121-b412fb9403f6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:23.502903 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6d39fbea-117d-46af-8121-b412fb9403f6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:23.511473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6d39fbea-117d-46af-8121-b412fb9403f6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.159663 Apr 12 15:17:23.512047 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 738/1451] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:23 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:24.528487 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-04bde58d-f798-43d2-a550-386eae4a05e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:24.529095 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-04bde58d-f798-43d2-a550-386eae4a05e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:24.535659 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-04bde58d-f798-43d2-a550-386eae4a05e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:24.536137 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-04bde58d-f798-43d2-a550-386eae4a05e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:24.536913 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-04bde58d-f798-43d2-a550-386eae4a05e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:24.537372 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-04bde58d-f798-43d2-a550-386eae4a05e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:24.675959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-04bde58d-f798-43d2-a550-386eae4a05e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:24.684351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-04bde58d-f798-43d2-a550-386eae4a05e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.159837 Apr 12 15:17:24.686567 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 714/1452] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:24 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:25.702729 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b827b06d-72ee-4e2f-bb08-0f1f4a99fb89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:25.703356 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b827b06d-72ee-4e2f-bb08-0f1f4a99fb89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:25.709835 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b827b06d-72ee-4e2f-bb08-0f1f4a99fb89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:25.710283 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b827b06d-72ee-4e2f-bb08-0f1f4a99fb89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:25.711090 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b827b06d-72ee-4e2f-bb08-0f1f4a99fb89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:25.711526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b827b06d-72ee-4e2f-bb08-0f1f4a99fb89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:25.847809 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b827b06d-72ee-4e2f-bb08-0f1f4a99fb89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:25.857885 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b827b06d-72ee-4e2f-bb08-0f1f4a99fb89 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.159065 Apr 12 15:17:25.858463 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 739/1453] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:25 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:26.876575 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7f6d1790-1575-4dcb-92ab-0e032257b56d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:26.877125 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7f6d1790-1575-4dcb-92ab-0e032257b56d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:26.884199 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7f6d1790-1575-4dcb-92ab-0e032257b56d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:26.884647 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7f6d1790-1575-4dcb-92ab-0e032257b56d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:26.885416 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7f6d1790-1575-4dcb-92ab-0e032257b56d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:26.885867 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7f6d1790-1575-4dcb-92ab-0e032257b56d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:27.013735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7f6d1790-1575-4dcb-92ab-0e032257b56d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:27.021676 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7f6d1790-1575-4dcb-92ab-0e032257b56d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.149091 Apr 12 15:17:27.022254 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 715/1454] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:26 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:28.039815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-609367ee-dee0-400e-8483-53349c060e66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:28.040422 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-609367ee-dee0-400e-8483-53349c060e66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:28.046719 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-609367ee-dee0-400e-8483-53349c060e66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:28.047158 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-609367ee-dee0-400e-8483-53349c060e66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:28.047910 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-609367ee-dee0-400e-8483-53349c060e66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:28.048338 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-609367ee-dee0-400e-8483-53349c060e66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:28.182101 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-609367ee-dee0-400e-8483-53349c060e66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:28.192408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-609367ee-dee0-400e-8483-53349c060e66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.157341 Apr 12 15:17:28.192981 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 740/1455] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:28 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:29.210062 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2ca01be7-bfd4-40bc-a08d-1730f4cf49a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:29.211230 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2ca01be7-bfd4-40bc-a08d-1730f4cf49a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:29.218710 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2ca01be7-bfd4-40bc-a08d-1730f4cf49a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:29.219155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2ca01be7-bfd4-40bc-a08d-1730f4cf49a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:29.219927 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2ca01be7-bfd4-40bc-a08d-1730f4cf49a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:29.220360 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2ca01be7-bfd4-40bc-a08d-1730f4cf49a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:29.348386 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2ca01be7-bfd4-40bc-a08d-1730f4cf49a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:29.356949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2ca01be7-bfd4-40bc-a08d-1730f4cf49a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.151049 Apr 12 15:17:29.357525 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 716/1456] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:29 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:30.375079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-71a04f87-c9f5-412a-8d3c-9568f0c5acd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:30.375711 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-71a04f87-c9f5-412a-8d3c-9568f0c5acd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:30.382595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71a04f87-c9f5-412a-8d3c-9568f0c5acd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:30.383220 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71a04f87-c9f5-412a-8d3c-9568f0c5acd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:30.383993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71a04f87-c9f5-412a-8d3c-9568f0c5acd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:30.384444 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-71a04f87-c9f5-412a-8d3c-9568f0c5acd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:30.512041 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-71a04f87-c9f5-412a-8d3c-9568f0c5acd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:30.519765 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-71a04f87-c9f5-412a-8d3c-9568f0c5acd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148657 Apr 12 15:17:30.520328 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 741/1457] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:30 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:31.536805 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-76b33433-e218-4db5-9260-0d4317af75cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:31.537417 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-76b33433-e218-4db5-9260-0d4317af75cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:31.545016 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-76b33433-e218-4db5-9260-0d4317af75cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:31.545470 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-76b33433-e218-4db5-9260-0d4317af75cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:31.546283 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-76b33433-e218-4db5-9260-0d4317af75cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:31.547051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-76b33433-e218-4db5-9260-0d4317af75cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:31.673877 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-76b33433-e218-4db5-9260-0d4317af75cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:31.682010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-76b33433-e218-4db5-9260-0d4317af75cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148913 Apr 12 15:17:31.682553 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 717/1458] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:31 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:32.701487 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-076d16e0-8dea-4d5b-8478-dabcfe15da0f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:32.702154 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-076d16e0-8dea-4d5b-8478-dabcfe15da0f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:32.708584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-076d16e0-8dea-4d5b-8478-dabcfe15da0f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:32.711230 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-076d16e0-8dea-4d5b-8478-dabcfe15da0f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:32.711230 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-076d16e0-8dea-4d5b-8478-dabcfe15da0f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:32.711230 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-076d16e0-8dea-4d5b-8478-dabcfe15da0f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:32.846380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-076d16e0-8dea-4d5b-8478-dabcfe15da0f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:32.855485 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-076d16e0-8dea-4d5b-8478-dabcfe15da0f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.158032 Apr 12 15:17:32.856080 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 742/1459] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:32 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:33.873717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-359af76c-5858-40a8-af12-f45290e804ef tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:33.874364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-359af76c-5858-40a8-af12-f45290e804ef tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:33.880638 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-359af76c-5858-40a8-af12-f45290e804ef tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:33.881086 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-359af76c-5858-40a8-af12-f45290e804ef tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:33.881884 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-359af76c-5858-40a8-af12-f45290e804ef tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:33.882321 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-359af76c-5858-40a8-af12-f45290e804ef tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:34.012765 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-359af76c-5858-40a8-af12-f45290e804ef tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:34.020660 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-359af76c-5858-40a8-af12-f45290e804ef tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150800 Apr 12 15:17:34.021231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 718/1460] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:33 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:35.038382 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e5b0ac25-859b-4445-ad61-84bf63f64fbc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:35.039205 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e5b0ac25-859b-4445-ad61-84bf63f64fbc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:35.045658 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5b0ac25-859b-4445-ad61-84bf63f64fbc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:35.046100 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5b0ac25-859b-4445-ad61-84bf63f64fbc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:35.046863 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5b0ac25-859b-4445-ad61-84bf63f64fbc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:35.047294 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5b0ac25-859b-4445-ad61-84bf63f64fbc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:35.176323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e5b0ac25-859b-4445-ad61-84bf63f64fbc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:35.184733 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e5b0ac25-859b-4445-ad61-84bf63f64fbc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150482 Apr 12 15:17:35.185305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 743/1461] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:35 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:36.205235 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0c1b094a-7311-4f28-a866-df0fd945dd9e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:36.206340 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0c1b094a-7311-4f28-a866-df0fd945dd9e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:36.212602 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0c1b094a-7311-4f28-a866-df0fd945dd9e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:36.213047 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0c1b094a-7311-4f28-a866-df0fd945dd9e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:36.213837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0c1b094a-7311-4f28-a866-df0fd945dd9e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:36.214270 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0c1b094a-7311-4f28-a866-df0fd945dd9e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:36.343680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0c1b094a-7311-4f28-a866-df0fd945dd9e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:36.352263 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0c1b094a-7311-4f28-a866-df0fd945dd9e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154079 Apr 12 15:17:36.352836 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 719/1462] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:36 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:37.188307 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:17:37.188887 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:17:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:17:37.370879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-99183e53-893a-4376-9402-bfb373985c21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:37.371487 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-99183e53-893a-4376-9402-bfb373985c21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:37.377993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99183e53-893a-4376-9402-bfb373985c21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:37.378430 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99183e53-893a-4376-9402-bfb373985c21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:37.379233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99183e53-893a-4376-9402-bfb373985c21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:37.379663 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99183e53-893a-4376-9402-bfb373985c21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:37.512351 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-99183e53-893a-4376-9402-bfb373985c21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:37.520313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-99183e53-893a-4376-9402-bfb373985c21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154331 Apr 12 15:17:37.520870 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 744/1463] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:37 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:38.538140 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dbe81674-9609-4816-ace7-00863890f76b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:38.539137 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dbe81674-9609-4816-ace7-00863890f76b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:38.547953 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbe81674-9609-4816-ace7-00863890f76b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:38.548395 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbe81674-9609-4816-ace7-00863890f76b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:38.549187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbe81674-9609-4816-ace7-00863890f76b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:38.549621 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dbe81674-9609-4816-ace7-00863890f76b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:38.683764 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dbe81674-9609-4816-ace7-00863890f76b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:38.691697 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dbe81674-9609-4816-ace7-00863890f76b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.157750 Apr 12 15:17:38.692269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 720/1464] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:38 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:17:39.709960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d94a957d-06ea-4e5d-bcd2-1651323b46f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:39.710591 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d94a957d-06ea-4e5d-bcd2-1651323b46f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:39.716959 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d94a957d-06ea-4e5d-bcd2-1651323b46f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:39.717405 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d94a957d-06ea-4e5d-bcd2-1651323b46f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:39.722075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d94a957d-06ea-4e5d-bcd2-1651323b46f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:39.722075 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d94a957d-06ea-4e5d-bcd2-1651323b46f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:39.846500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d94a957d-06ea-4e5d-bcd2-1651323b46f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:39.855199 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d94a957d-06ea-4e5d-bcd2-1651323b46f9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.149135 Apr 12 15:17:39.855774 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 745/1465] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:39 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:40.872332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-74c82af6-4605-44f0-88e1-5a123b0eae51 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:40.872946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-74c82af6-4605-44f0-88e1-5a123b0eae51 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:40.879327 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-74c82af6-4605-44f0-88e1-5a123b0eae51 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:40.879775 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-74c82af6-4605-44f0-88e1-5a123b0eae51 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:40.880541 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-74c82af6-4605-44f0-88e1-5a123b0eae51 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:40.881000 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-74c82af6-4605-44f0-88e1-5a123b0eae51 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:41.004381 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-74c82af6-4605-44f0-88e1-5a123b0eae51 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:41.012674 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-74c82af6-4605-44f0-88e1-5a123b0eae51 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.144179 Apr 12 15:17:41.013241 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 721/1466] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:40 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:42.031357 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-40e8606e-bde1-451a-9d46-dbecb60dd920 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:42.031960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-40e8606e-bde1-451a-9d46-dbecb60dd920 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:42.044140 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40e8606e-bde1-451a-9d46-dbecb60dd920 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:42.044939 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40e8606e-bde1-451a-9d46-dbecb60dd920 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:42.046412 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40e8606e-bde1-451a-9d46-dbecb60dd920 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:42.047185 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-40e8606e-bde1-451a-9d46-dbecb60dd920 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:42.180728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-40e8606e-bde1-451a-9d46-dbecb60dd920 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:42.188722 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-40e8606e-bde1-451a-9d46-dbecb60dd920 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.161739 Apr 12 15:17:42.189288 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 746/1467] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:42 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:43.205920 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e75b60c7-d30f-4fc1-b13d-284d5f42c3e8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:43.206530 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e75b60c7-d30f-4fc1-b13d-284d5f42c3e8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:43.213902 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e75b60c7-d30f-4fc1-b13d-284d5f42c3e8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:43.214339 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e75b60c7-d30f-4fc1-b13d-284d5f42c3e8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:43.215109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e75b60c7-d30f-4fc1-b13d-284d5f42c3e8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:43.215533 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e75b60c7-d30f-4fc1-b13d-284d5f42c3e8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:43.358986 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e75b60c7-d30f-4fc1-b13d-284d5f42c3e8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:43.368133 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e75b60c7-d30f-4fc1-b13d-284d5f42c3e8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.165603 Apr 12 15:17:43.368793 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 722/1468] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:43 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:44.393339 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c4f6109e-ad8c-4477-9c7b-b6ad82b0584a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:44.394058 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c4f6109e-ad8c-4477-9c7b-b6ad82b0584a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:44.400879 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4f6109e-ad8c-4477-9c7b-b6ad82b0584a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:44.401337 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4f6109e-ad8c-4477-9c7b-b6ad82b0584a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:44.402142 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4f6109e-ad8c-4477-9c7b-b6ad82b0584a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:44.402574 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c4f6109e-ad8c-4477-9c7b-b6ad82b0584a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:44.530481 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c4f6109e-ad8c-4477-9c7b-b6ad82b0584a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:44.538616 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c4f6109e-ad8c-4477-9c7b-b6ad82b0584a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.149508 Apr 12 15:17:44.539262 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 747/1469] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:44 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:45.555791 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6dad8074-e37c-4b83-9ab8-cfe6fb18549c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:45.556426 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6dad8074-e37c-4b83-9ab8-cfe6fb18549c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:45.562780 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6dad8074-e37c-4b83-9ab8-cfe6fb18549c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:45.563223 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6dad8074-e37c-4b83-9ab8-cfe6fb18549c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:45.564020 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6dad8074-e37c-4b83-9ab8-cfe6fb18549c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:45.564449 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6dad8074-e37c-4b83-9ab8-cfe6fb18549c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:45.629174 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:17:45.629985 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:17:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:17:45.700480 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6dad8074-e37c-4b83-9ab8-cfe6fb18549c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:45.708459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6dad8074-e37c-4b83-9ab8-cfe6fb18549c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.157194 Apr 12 15:17:45.709033 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 723/1470] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:45 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:46.726054 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0794f9ae-f917-449c-96b9-77b46c12d78d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:46.726662 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0794f9ae-f917-449c-96b9-77b46c12d78d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:46.733161 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0794f9ae-f917-449c-96b9-77b46c12d78d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:46.733603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0794f9ae-f917-449c-96b9-77b46c12d78d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:46.734511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0794f9ae-f917-449c-96b9-77b46c12d78d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:46.734943 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0794f9ae-f917-449c-96b9-77b46c12d78d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:46.860906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0794f9ae-f917-449c-96b9-77b46c12d78d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:46.869960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0794f9ae-f917-449c-96b9-77b46c12d78d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.147680 Apr 12 15:17:46.870518 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 748/1471] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:46 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:47.046135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:17:47.046872 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:17:47.887407 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ae6cd1c8-81dd-4778-8c24-88f6c6ec4724 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:47.887922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ae6cd1c8-81dd-4778-8c24-88f6c6ec4724 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:47.894331 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae6cd1c8-81dd-4778-8c24-88f6c6ec4724 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:47.894783 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae6cd1c8-81dd-4778-8c24-88f6c6ec4724 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:47.895551 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae6cd1c8-81dd-4778-8c24-88f6c6ec4724 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:47.895985 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ae6cd1c8-81dd-4778-8c24-88f6c6ec4724 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:48.025650 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ae6cd1c8-81dd-4778-8c24-88f6c6ec4724 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:48.033952 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ae6cd1c8-81dd-4778-8c24-88f6c6ec4724 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150424 Apr 12 15:17:48.034514 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 724/1472] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:47 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:49.059955 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-2111ac8b-b19e-4abe-bb4d-cf76672f630d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:49.060554 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-2111ac8b-b19e-4abe-bb4d-cf76672f630d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:49.066705 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2111ac8b-b19e-4abe-bb4d-cf76672f630d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:49.067144 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2111ac8b-b19e-4abe-bb4d-cf76672f630d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:49.067896 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2111ac8b-b19e-4abe-bb4d-cf76672f630d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:49.068327 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-2111ac8b-b19e-4abe-bb4d-cf76672f630d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:49.193976 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-2111ac8b-b19e-4abe-bb4d-cf76672f630d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:49.203446 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-2111ac8b-b19e-4abe-bb4d-cf76672f630d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.147505 Apr 12 15:17:49.204015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 749/1473] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:49 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:50.221186 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-452d4186-b839-40c5-a048-e999681bad5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:50.221797 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-452d4186-b839-40c5-a048-e999681bad5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:50.227837 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-452d4186-b839-40c5-a048-e999681bad5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:50.228279 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-452d4186-b839-40c5-a048-e999681bad5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:50.229043 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-452d4186-b839-40c5-a048-e999681bad5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:50.229474 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-452d4186-b839-40c5-a048-e999681bad5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:50.598046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-452d4186-b839-40c5-a048-e999681bad5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:50.606453 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-452d4186-b839-40c5-a048-e999681bad5d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.389427 Apr 12 15:17:50.607029 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 725/1474] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:50 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:51.623825 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9054dd64-f432-4490-be79-8c22ec3696e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:51.624419 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9054dd64-f432-4490-be79-8c22ec3696e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:51.630497 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9054dd64-f432-4490-be79-8c22ec3696e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:51.630939 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9054dd64-f432-4490-be79-8c22ec3696e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:51.631737 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9054dd64-f432-4490-be79-8c22ec3696e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:51.632375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9054dd64-f432-4490-be79-8c22ec3696e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:51.758349 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9054dd64-f432-4490-be79-8c22ec3696e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:51.766019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9054dd64-f432-4490-be79-8c22ec3696e2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.146217 Apr 12 15:17:51.766570 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 750/1475] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:51 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:52.783602 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-aa89c1ab-42ca-437b-a69c-eabd76ebb7cf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:52.784187 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-aa89c1ab-42ca-437b-a69c-eabd76ebb7cf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:52.791680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa89c1ab-42ca-437b-a69c-eabd76ebb7cf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:52.796149 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa89c1ab-42ca-437b-a69c-eabd76ebb7cf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:52.796149 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa89c1ab-42ca-437b-a69c-eabd76ebb7cf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:52.796149 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-aa89c1ab-42ca-437b-a69c-eabd76ebb7cf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:52.928046 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-aa89c1ab-42ca-437b-a69c-eabd76ebb7cf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:52.936295 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-aa89c1ab-42ca-437b-a69c-eabd76ebb7cf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.156667 Apr 12 15:17:52.936874 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 726/1476] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:52 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:53.953783 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d2c43f64-03d9-40b3-9d1f-3a78df819c47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:53.954376 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d2c43f64-03d9-40b3-9d1f-3a78df819c47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:53.962132 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d2c43f64-03d9-40b3-9d1f-3a78df819c47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:53.962520 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d2c43f64-03d9-40b3-9d1f-3a78df819c47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:53.963282 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d2c43f64-03d9-40b3-9d1f-3a78df819c47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:53.963821 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d2c43f64-03d9-40b3-9d1f-3a78df819c47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:54.091733 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d2c43f64-03d9-40b3-9d1f-3a78df819c47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:54.099581 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d2c43f64-03d9-40b3-9d1f-3a78df819c47 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.149811 Apr 12 15:17:54.100166 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 751/1477] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:53 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:55.116258 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fed2ee9e-cab2-41aa-8abb-eb842925eb69 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:55.116876 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fed2ee9e-cab2-41aa-8abb-eb842925eb69 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:55.123207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fed2ee9e-cab2-41aa-8abb-eb842925eb69 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:55.123660 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fed2ee9e-cab2-41aa-8abb-eb842925eb69 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:55.124424 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fed2ee9e-cab2-41aa-8abb-eb842925eb69 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:55.124855 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fed2ee9e-cab2-41aa-8abb-eb842925eb69 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:55.254020 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fed2ee9e-cab2-41aa-8abb-eb842925eb69 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:55.262347 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fed2ee9e-cab2-41aa-8abb-eb842925eb69 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.149973 Apr 12 15:17:55.262851 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 727/1478] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:55 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:56.279767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bf3dba7c-bb67-4b46-b0e8-5b614758a76a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:56.280366 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bf3dba7c-bb67-4b46-b0e8-5b614758a76a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:56.286654 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf3dba7c-bb67-4b46-b0e8-5b614758a76a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:56.287356 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf3dba7c-bb67-4b46-b0e8-5b614758a76a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:56.288669 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf3dba7c-bb67-4b46-b0e8-5b614758a76a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:56.289093 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bf3dba7c-bb67-4b46-b0e8-5b614758a76a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:56.419815 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bf3dba7c-bb67-4b46-b0e8-5b614758a76a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:56.430010 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bf3dba7c-bb67-4b46-b0e8-5b614758a76a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154173 Apr 12 15:17:56.430532 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 752/1479] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:56 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:57.447693 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-06ccbca5-97a2-4d2a-89e4-5d8667536963 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:57.448304 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-06ccbca5-97a2-4d2a-89e4-5d8667536963 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:57.454706 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ccbca5-97a2-4d2a-89e4-5d8667536963 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:57.455154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ccbca5-97a2-4d2a-89e4-5d8667536963 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:57.455927 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ccbca5-97a2-4d2a-89e4-5d8667536963 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:57.456361 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-06ccbca5-97a2-4d2a-89e4-5d8667536963 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:57.586102 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-06ccbca5-97a2-4d2a-89e4-5d8667536963 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:57.594132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-06ccbca5-97a2-4d2a-89e4-5d8667536963 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.151015 Apr 12 15:17:57.594705 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 728/1480] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:57 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:58.611975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-99e0e01c-ad72-450a-8c88-a8027288ed16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:58.612637 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-99e0e01c-ad72-450a-8c88-a8027288ed16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:58.620194 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99e0e01c-ad72-450a-8c88-a8027288ed16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:58.620642 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99e0e01c-ad72-450a-8c88-a8027288ed16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:58.621410 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99e0e01c-ad72-450a-8c88-a8027288ed16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:58.621865 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-99e0e01c-ad72-450a-8c88-a8027288ed16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:58.756008 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-99e0e01c-ad72-450a-8c88-a8027288ed16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:58.764909 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-99e0e01c-ad72-450a-8c88-a8027288ed16 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.156752 Apr 12 15:17:58.765460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 753/1481] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:58 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:17:59.712922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:17:59.713478 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:17:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:17:59.758773 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:17:59.759282 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:17:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:17:59.782291 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0bda0894-6244-42dc-ba38-f10da08cbb6f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:17:59.782927 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0bda0894-6244-42dc-ba38-f10da08cbb6f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:17:59.790240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bda0894-6244-42dc-ba38-f10da08cbb6f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:59.790678 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bda0894-6244-42dc-ba38-f10da08cbb6f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:59.791433 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bda0894-6244-42dc-ba38-f10da08cbb6f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:17:59.791861 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0bda0894-6244-42dc-ba38-f10da08cbb6f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:17:59.917957 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0bda0894-6244-42dc-ba38-f10da08cbb6f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:17:59.927420 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0bda0894-6244-42dc-ba38-f10da08cbb6f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148482 Apr 12 15:17:59.928456 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 729/1482] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:17:59 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:00.944629 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-714a09f7-796f-46b2-8b0b-912f7991b753 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:00.945756 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-714a09f7-796f-46b2-8b0b-912f7991b753 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:00.952318 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-714a09f7-796f-46b2-8b0b-912f7991b753 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:00.952764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-714a09f7-796f-46b2-8b0b-912f7991b753 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:00.953527 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-714a09f7-796f-46b2-8b0b-912f7991b753 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:00.953984 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-714a09f7-796f-46b2-8b0b-912f7991b753 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:01.092095 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-714a09f7-796f-46b2-8b0b-912f7991b753 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:01.100543 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-714a09f7-796f-46b2-8b0b-912f7991b753 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.159277 Apr 12 15:18:01.101142 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 754/1483] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:00 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:02.118636 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3be852b1-ea7c-4ffe-b87c-3d99359651df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:02.119272 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3be852b1-ea7c-4ffe-b87c-3d99359651df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:02.125523 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3be852b1-ea7c-4ffe-b87c-3d99359651df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:02.125998 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3be852b1-ea7c-4ffe-b87c-3d99359651df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:02.126752 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3be852b1-ea7c-4ffe-b87c-3d99359651df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:02.127179 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3be852b1-ea7c-4ffe-b87c-3d99359651df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:02.253693 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3be852b1-ea7c-4ffe-b87c-3d99359651df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:02.261923 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3be852b1-ea7c-4ffe-b87c-3d99359651df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.148037 Apr 12 15:18:02.262481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 730/1484] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:02 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:18:03.279501 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-15784661-caef-43d3-a97d-b30a1ed3afd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:03.280131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-15784661-caef-43d3-a97d-b30a1ed3afd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:03.287184 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15784661-caef-43d3-a97d-b30a1ed3afd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:03.287720 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15784661-caef-43d3-a97d-b30a1ed3afd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:03.288579 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15784661-caef-43d3-a97d-b30a1ed3afd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:03.289083 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-15784661-caef-43d3-a97d-b30a1ed3afd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:03.421376 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-15784661-caef-43d3-a97d-b30a1ed3afd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:03.429339 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-15784661-caef-43d3-a97d-b30a1ed3afd8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.153697 Apr 12 15:18:03.429929 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 755/1485] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:03 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:04.446831 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-225f3b55-38c0-4e05-b03b-bdcf7b2a8f66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:04.447847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-225f3b55-38c0-4e05-b03b-bdcf7b2a8f66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:04.454215 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-225f3b55-38c0-4e05-b03b-bdcf7b2a8f66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:04.454655 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-225f3b55-38c0-4e05-b03b-bdcf7b2a8f66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:04.455410 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-225f3b55-38c0-4e05-b03b-bdcf7b2a8f66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:04.455833 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-225f3b55-38c0-4e05-b03b-bdcf7b2a8f66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:04.590522 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-225f3b55-38c0-4e05-b03b-bdcf7b2a8f66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:04.598381 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-225f3b55-38c0-4e05-b03b-bdcf7b2a8f66 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.155496 Apr 12 15:18:04.599034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 731/1486] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:04 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:05.616297 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-ee3a0d67-f8a9-4ead-a5ab-5611ae061de6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:05.616907 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-ee3a0d67-f8a9-4ead-a5ab-5611ae061de6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:05.623153 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee3a0d67-f8a9-4ead-a5ab-5611ae061de6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:05.623596 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee3a0d67-f8a9-4ead-a5ab-5611ae061de6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:05.624352 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee3a0d67-f8a9-4ead-a5ab-5611ae061de6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:05.624780 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-ee3a0d67-f8a9-4ead-a5ab-5611ae061de6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:05.751767 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-ee3a0d67-f8a9-4ead-a5ab-5611ae061de6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:05.760136 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-ee3a0d67-f8a9-4ead-a5ab-5611ae061de6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.147735 Apr 12 15:18:05.760634 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 756/1487] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:05 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:06.776928 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-172b4724-85cc-4f4b-86d6-d35207c60605 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:06.777624 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-172b4724-85cc-4f4b-86d6-d35207c60605 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:06.783821 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-172b4724-85cc-4f4b-86d6-d35207c60605 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:06.784265 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-172b4724-85cc-4f4b-86d6-d35207c60605 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:06.785025 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-172b4724-85cc-4f4b-86d6-d35207c60605 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:06.785452 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-172b4724-85cc-4f4b-86d6-d35207c60605 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:06.920324 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-172b4724-85cc-4f4b-86d6-d35207c60605 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:06.927977 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-172b4724-85cc-4f4b-86d6-d35207c60605 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154969 Apr 12 15:18:06.928895 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 732/1488] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:06 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:07.947113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8647a1c4-bb3c-4ac8-b9fe-0515305814b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:07.947687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8647a1c4-bb3c-4ac8-b9fe-0515305814b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:07.954169 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8647a1c4-bb3c-4ac8-b9fe-0515305814b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:07.954612 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8647a1c4-bb3c-4ac8-b9fe-0515305814b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:07.955380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8647a1c4-bb3c-4ac8-b9fe-0515305814b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:07.955809 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8647a1c4-bb3c-4ac8-b9fe-0515305814b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:08.102333 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8647a1c4-bb3c-4ac8-b9fe-0515305814b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:08.113757 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8647a1c4-bb3c-4ac8-b9fe-0515305814b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.170780 Apr 12 15:18:08.114598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 757/1489] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:07 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:09.136944 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-0a47fcc9-6695-411c-ac68-1df366b0fbe9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:09.137581 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-0a47fcc9-6695-411c-ac68-1df366b0fbe9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:09.143886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a47fcc9-6695-411c-ac68-1df366b0fbe9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:09.144331 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a47fcc9-6695-411c-ac68-1df366b0fbe9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:09.145092 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a47fcc9-6695-411c-ac68-1df366b0fbe9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:09.145522 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-0a47fcc9-6695-411c-ac68-1df366b0fbe9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:09.271001 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-0a47fcc9-6695-411c-ac68-1df366b0fbe9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:09.278999 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-0a47fcc9-6695-411c-ac68-1df366b0fbe9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.145923 Apr 12 15:18:09.279574 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 733/1490] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:09 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:10.297005 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3565eb49-2f3a-4a0b-8243-f69dc02e35e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:10.297611 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3565eb49-2f3a-4a0b-8243-f69dc02e35e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:10.304544 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3565eb49-2f3a-4a0b-8243-f69dc02e35e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:10.304982 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3565eb49-2f3a-4a0b-8243-f69dc02e35e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:10.305811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3565eb49-2f3a-4a0b-8243-f69dc02e35e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:10.306235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3565eb49-2f3a-4a0b-8243-f69dc02e35e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:10.438850 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3565eb49-2f3a-4a0b-8243-f69dc02e35e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:10.447159 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3565eb49-2f3a-4a0b-8243-f69dc02e35e4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.154064 Apr 12 15:18:10.447726 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 758/1491] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:10 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:11.464835 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-15ac3921-e3b0-4063-833b-8dfa84114c3c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:11.465448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-15ac3921-e3b0-4063-833b-8dfa84114c3c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:11.471799 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-15ac3921-e3b0-4063-833b-8dfa84114c3c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:11.472249 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-15ac3921-e3b0-4063-833b-8dfa84114c3c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:11.473022 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-15ac3921-e3b0-4063-833b-8dfa84114c3c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:11.473453 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-15ac3921-e3b0-4063-833b-8dfa84114c3c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:11.603718 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-15ac3921-e3b0-4063-833b-8dfa84114c3c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:11.611584 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-15ac3921-e3b0-4063-833b-8dfa84114c3c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150661 Apr 12 15:18:11.612150 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 734/1492] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:11 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:12.628193 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-13d90d11-e3be-42ef-9cef-f22ec2b6cded tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:12.628805 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-13d90d11-e3be-42ef-9cef-f22ec2b6cded tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:12.635263 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-13d90d11-e3be-42ef-9cef-f22ec2b6cded tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:12.635712 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-13d90d11-e3be-42ef-9cef-f22ec2b6cded tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:12.636478 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-13d90d11-e3be-42ef-9cef-f22ec2b6cded tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:12.636911 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-13d90d11-e3be-42ef-9cef-f22ec2b6cded tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:12.766779 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-13d90d11-e3be-42ef-9cef-f22ec2b6cded tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:12.775314 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-13d90d11-e3be-42ef-9cef-f22ec2b6cded tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.150938 Apr 12 15:18:12.778475 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 759/1493] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:12 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:13.792465 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-283ec9e0-85d0-4d74-a0b9-66492dbf6f1d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:13.793040 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-283ec9e0-85d0-4d74-a0b9-66492dbf6f1d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:13.799240 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-283ec9e0-85d0-4d74-a0b9-66492dbf6f1d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:13.799678 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-283ec9e0-85d0-4d74-a0b9-66492dbf6f1d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:13.800433 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-283ec9e0-85d0-4d74-a0b9-66492dbf6f1d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:13.800857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-283ec9e0-85d0-4d74-a0b9-66492dbf6f1d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:13.926526 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-283ec9e0-85d0-4d74-a0b9-66492dbf6f1d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:13.935536 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-283ec9e0-85d0-4d74-a0b9-66492dbf6f1d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.146911 Apr 12 15:18:13.936109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 735/1494] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:13 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:14.953899 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c5aea14b-1dc6-45ad-a7cf-3c3c4f7e2f8e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:14.954507 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c5aea14b-1dc6-45ad-a7cf-3c3c4f7e2f8e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:14.961329 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5aea14b-1dc6-45ad-a7cf-3c3c4f7e2f8e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:14.961814 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5aea14b-1dc6-45ad-a7cf-3c3c4f7e2f8e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:14.962583 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5aea14b-1dc6-45ad-a7cf-3c3c4f7e2f8e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:14.963017 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5aea14b-1dc6-45ad-a7cf-3c3c4f7e2f8e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:15.094871 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c5aea14b-1dc6-45ad-a7cf-3c3c4f7e2f8e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:15.103373 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c5aea14b-1dc6-45ad-a7cf-3c3c4f7e2f8e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.153365 Apr 12 15:18:15.103948 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 760/1495] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:14 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:16.122398 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-cce5b9ea-0e29-4c71-9719-58e35bfa17f0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:16.123004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cce5b9ea-0e29-4c71-9719-58e35bfa17f0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:16.129293 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cce5b9ea-0e29-4c71-9719-58e35bfa17f0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:16.129762 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cce5b9ea-0e29-4c71-9719-58e35bfa17f0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:16.130542 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cce5b9ea-0e29-4c71-9719-58e35bfa17f0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:16.131701 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cce5b9ea-0e29-4c71-9719-58e35bfa17f0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:16.272183 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-cce5b9ea-0e29-4c71-9719-58e35bfa17f0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:16.280199 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-cce5b9ea-0e29-4c71-9719-58e35bfa17f0 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.161660 Apr 12 15:18:16.280766 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 736/1496] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:16 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:17.300539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9f58f859-af51-4893-84ad-8251d01983c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:17.301167 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9f58f859-af51-4893-84ad-8251d01983c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:17.308210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f58f859-af51-4893-84ad-8251d01983c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:17.308652 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f58f859-af51-4893-84ad-8251d01983c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:17.309458 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f58f859-af51-4893-84ad-8251d01983c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:17.309913 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f58f859-af51-4893-84ad-8251d01983c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:17.444921 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9f58f859-af51-4893-84ad-8251d01983c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:17.453717 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9f58f859-af51-4893-84ad-8251d01983c8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.159020 Apr 12 15:18:17.454293 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 761/1497] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:17 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:18.470896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8ba03b1f-1206-4de5-a40d-6c8b9ab0fee8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:18.471495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8ba03b1f-1206-4de5-a40d-6c8b9ab0fee8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:18.478381 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ba03b1f-1206-4de5-a40d-6c8b9ab0fee8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:18.478838 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ba03b1f-1206-4de5-a40d-6c8b9ab0fee8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:18.479614 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ba03b1f-1206-4de5-a40d-6c8b9ab0fee8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:18.480048 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8ba03b1f-1206-4de5-a40d-6c8b9ab0fee8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:18.611283 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8ba03b1f-1206-4de5-a40d-6c8b9ab0fee8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:18.619760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8ba03b1f-1206-4de5-a40d-6c8b9ab0fee8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.152887 Apr 12 15:18:18.620333 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 737/1498] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:18 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:19.637466 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6c0edffa-20a6-4fcf-97f8-0bb0bb7558a4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:19.638101 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6c0edffa-20a6-4fcf-97f8-0bb0bb7558a4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:19.644371 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c0edffa-20a6-4fcf-97f8-0bb0bb7558a4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:19.644819 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c0edffa-20a6-4fcf-97f8-0bb0bb7558a4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:19.645580 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c0edffa-20a6-4fcf-97f8-0bb0bb7558a4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:19.646037 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6c0edffa-20a6-4fcf-97f8-0bb0bb7558a4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:19.770755 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6c0edffa-20a6-4fcf-97f8-0bb0bb7558a4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:19.778814 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6c0edffa-20a6-4fcf-97f8-0bb0bb7558a4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1560 microversion: 2.1 time: 0.145240 Apr 12 15:18:19.779370 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 762/1499] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:19 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:20.600807 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-f79327c8-637d-4721-98dc-8993598d6b3d req-1e1ae8a7-c68b-4fa3-80c1-b61f3a5ebbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39507a5-c1c1-4c1f-b6f2-bc75f4807e80", "name": "network-vif-deleted", "tag": "9451047e-0681-4617-98f0-222c5f69ceb6"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:18:20.609103 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-f79327c8-637d-4721-98dc-8993598d6b3d req-1e1ae8a7-c68b-4fa3-80c1-b61f3a5ebbfc service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:20.609569 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-f79327c8-637d-4721-98dc-8993598d6b3d req-1e1ae8a7-c68b-4fa3-80c1-b61f3a5ebbfc service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:20.621152 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-f79327c8-637d-4721-98dc-8993598d6b3d req-1e1ae8a7-c68b-4fa3-80c1-b61f3a5ebbfc service nova] Creating event network-vif-deleted:9451047e-0681-4617-98f0-222c5f69ceb6 for instance b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 on hv-cinder-83752 Apr 12 15:18:20.626226 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-f79327c8-637d-4721-98dc-8993598d6b3d req-1e1ae8a7-c68b-4fa3-80c1-b61f3a5ebbfc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029852 Apr 12 15:18:20.626823 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 738/1500] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:18:20.796315 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8b9ec27a-d332-45e7-8980-2b990f4805a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:20.796920 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8b9ec27a-d332-45e7-8980-2b990f4805a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:20.803820 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b9ec27a-d332-45e7-8980-2b990f4805a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:20.804261 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b9ec27a-d332-45e7-8980-2b990f4805a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:20.805019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b9ec27a-d332-45e7-8980-2b990f4805a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:20.805448 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b9ec27a-d332-45e7-8980-2b990f4805a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:20.864543 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8b9ec27a-d332-45e7-8980-2b990f4805a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:20.873011 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8b9ec27a-d332-45e7-8980-2b990f4805a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.080610 Apr 12 15:18:20.873557 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 763/1501] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:20 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:21.891432 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-fdc6c74d-e87d-4fd5-9de0-c98b35459b15 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:21.892010 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-fdc6c74d-e87d-4fd5-9de0-c98b35459b15 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:21.899034 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fdc6c74d-e87d-4fd5-9de0-c98b35459b15 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:21.899472 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fdc6c74d-e87d-4fd5-9de0-c98b35459b15 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:21.900225 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fdc6c74d-e87d-4fd5-9de0-c98b35459b15 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:21.900653 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-fdc6c74d-e87d-4fd5-9de0-c98b35459b15 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:21.965314 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-fdc6c74d-e87d-4fd5-9de0-c98b35459b15 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:21.973254 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-fdc6c74d-e87d-4fd5-9de0-c98b35459b15 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.086699 Apr 12 15:18:21.973868 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 739/1502] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:21 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:22.990980 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-52040e38-a3b7-460d-abfe-871ce9d41a46 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:22.991562 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-52040e38-a3b7-460d-abfe-871ce9d41a46 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:22.997786 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52040e38-a3b7-460d-abfe-871ce9d41a46 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:22.998227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52040e38-a3b7-460d-abfe-871ce9d41a46 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:22.998979 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52040e38-a3b7-460d-abfe-871ce9d41a46 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:22.999401 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52040e38-a3b7-460d-abfe-871ce9d41a46 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:23.064509 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-52040e38-a3b7-460d-abfe-871ce9d41a46 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:23.073526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-52040e38-a3b7-460d-abfe-871ce9d41a46 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.087090 Apr 12 15:18:23.074122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 764/1503] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:22 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:24.092446 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d48646b3-7763-4a4c-a0f9-c53ed0fd1618 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:24.093073 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d48646b3-7763-4a4c-a0f9-c53ed0fd1618 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:24.100381 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d48646b3-7763-4a4c-a0f9-c53ed0fd1618 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:24.100821 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d48646b3-7763-4a4c-a0f9-c53ed0fd1618 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:24.101607 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d48646b3-7763-4a4c-a0f9-c53ed0fd1618 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:24.102064 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d48646b3-7763-4a4c-a0f9-c53ed0fd1618 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:24.163572 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d48646b3-7763-4a4c-a0f9-c53ed0fd1618 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:24.171491 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d48646b3-7763-4a4c-a0f9-c53ed0fd1618 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082912 Apr 12 15:18:24.172055 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 740/1504] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:24 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:25.188247 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-5687383c-f8cc-4c72-ad7a-1247151c37b2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:25.188851 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-5687383c-f8cc-4c72-ad7a-1247151c37b2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:25.195828 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5687383c-f8cc-4c72-ad7a-1247151c37b2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:25.196267 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5687383c-f8cc-4c72-ad7a-1247151c37b2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:25.197019 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5687383c-f8cc-4c72-ad7a-1247151c37b2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:25.197442 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-5687383c-f8cc-4c72-ad7a-1247151c37b2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:25.258533 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-5687383c-f8cc-4c72-ad7a-1247151c37b2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:25.266306 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-5687383c-f8cc-4c72-ad7a-1247151c37b2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081935 Apr 12 15:18:25.266874 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 765/1505] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:25 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:26.284022 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-248c56de-3098-4697-8308-76fef772f778 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:26.284630 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-248c56de-3098-4697-8308-76fef772f778 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:26.291934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-248c56de-3098-4697-8308-76fef772f778 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:26.292373 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-248c56de-3098-4697-8308-76fef772f778 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:26.293129 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-248c56de-3098-4697-8308-76fef772f778 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:26.293554 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-248c56de-3098-4697-8308-76fef772f778 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:26.360515 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-248c56de-3098-4697-8308-76fef772f778 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:26.368972 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-248c56de-3098-4697-8308-76fef772f778 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.088742 Apr 12 15:18:26.369552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 741/1506] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:26 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:27.387210 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f5e6dd2e-be3c-45c0-9e53-d2c09d286817 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:27.387811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f5e6dd2e-be3c-45c0-9e53-d2c09d286817 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:27.394375 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5e6dd2e-be3c-45c0-9e53-d2c09d286817 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:27.395315 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5e6dd2e-be3c-45c0-9e53-d2c09d286817 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:27.395572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5e6dd2e-be3c-45c0-9e53-d2c09d286817 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:27.396774 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5e6dd2e-be3c-45c0-9e53-d2c09d286817 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:27.456571 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f5e6dd2e-be3c-45c0-9e53-d2c09d286817 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:27.465961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f5e6dd2e-be3c-45c0-9e53-d2c09d286817 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082724 Apr 12 15:18:27.466535 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 766/1507] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:27 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:28.483281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-43a436a3-917f-49b6-b641-3b8f01eb57e1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:28.483906 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-43a436a3-917f-49b6-b641-3b8f01eb57e1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:28.490637 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43a436a3-917f-49b6-b641-3b8f01eb57e1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:28.490939 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43a436a3-917f-49b6-b641-3b8f01eb57e1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:28.491720 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43a436a3-917f-49b6-b641-3b8f01eb57e1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:28.492165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-43a436a3-917f-49b6-b641-3b8f01eb57e1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:28.557303 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-43a436a3-917f-49b6-b641-3b8f01eb57e1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:28.565231 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-43a436a3-917f-49b6-b641-3b8f01eb57e1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.085892 Apr 12 15:18:28.565835 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 742/1508] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:28 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:29.582519 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e049fd66-492f-451a-8455-299ee8a09e32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:29.583162 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e049fd66-492f-451a-8455-299ee8a09e32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:29.589526 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e049fd66-492f-451a-8455-299ee8a09e32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:29.590010 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e049fd66-492f-451a-8455-299ee8a09e32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:29.590770 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e049fd66-492f-451a-8455-299ee8a09e32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:29.591202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e049fd66-492f-451a-8455-299ee8a09e32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:29.654900 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e049fd66-492f-451a-8455-299ee8a09e32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:29.664956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e049fd66-492f-451a-8455-299ee8a09e32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.086349 Apr 12 15:18:29.665543 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 767/1509] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:29 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:30.682825 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-5beb6bda-f5eb-442d-bceb-7cd139eaad11 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:30.683359 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-5beb6bda-f5eb-442d-bceb-7cd139eaad11 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:30.689787 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5beb6bda-f5eb-442d-bceb-7cd139eaad11 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:30.690242 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5beb6bda-f5eb-442d-bceb-7cd139eaad11 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:30.691011 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5beb6bda-f5eb-442d-bceb-7cd139eaad11 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:30.691445 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-5beb6bda-f5eb-442d-bceb-7cd139eaad11 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:30.765760 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-5beb6bda-f5eb-442d-bceb-7cd139eaad11 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:30.773651 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-5beb6bda-f5eb-442d-bceb-7cd139eaad11 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.094862 Apr 12 15:18:30.774236 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 743/1510] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:30 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:31.791012 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bb817f89-d9cd-4c28-b0c3-68ed149b5d0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:31.791649 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bb817f89-d9cd-4c28-b0c3-68ed149b5d0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:31.798256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb817f89-d9cd-4c28-b0c3-68ed149b5d0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:31.798703 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb817f89-d9cd-4c28-b0c3-68ed149b5d0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:31.799487 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb817f89-d9cd-4c28-b0c3-68ed149b5d0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:31.799922 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bb817f89-d9cd-4c28-b0c3-68ed149b5d0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:31.866184 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bb817f89-d9cd-4c28-b0c3-68ed149b5d0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:31.874168 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bb817f89-d9cd-4c28-b0c3-68ed149b5d0e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.086956 Apr 12 15:18:31.874752 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 768/1511] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:31 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:18:32.891833 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6ca1719a-e027-4f34-8a3b-4d5c9edd0c58 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:32.892392 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6ca1719a-e027-4f34-8a3b-4d5c9edd0c58 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:32.899622 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6ca1719a-e027-4f34-8a3b-4d5c9edd0c58 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:32.900102 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6ca1719a-e027-4f34-8a3b-4d5c9edd0c58 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:32.900875 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6ca1719a-e027-4f34-8a3b-4d5c9edd0c58 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:32.901304 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6ca1719a-e027-4f34-8a3b-4d5c9edd0c58 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:32.961874 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6ca1719a-e027-4f34-8a3b-4d5c9edd0c58 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:32.970946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6ca1719a-e027-4f34-8a3b-4d5c9edd0c58 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082997 Apr 12 15:18:32.971549 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 744/1512] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:32 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:33.988898 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3e07620b-9283-417a-ad54-776bef8b807a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:33.989380 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3e07620b-9283-417a-ad54-776bef8b807a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:33.997106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3e07620b-9283-417a-ad54-776bef8b807a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:33.997543 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3e07620b-9283-417a-ad54-776bef8b807a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:33.998425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3e07620b-9283-417a-ad54-776bef8b807a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:33.998855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3e07620b-9283-417a-ad54-776bef8b807a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:34.064367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3e07620b-9283-417a-ad54-776bef8b807a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:34.073340 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3e07620b-9283-417a-ad54-776bef8b807a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.088559 Apr 12 15:18:34.077708 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 769/1513] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:33 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:35.090719 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f1cbca5b-1dcd-4dae-a16d-9be63d036283 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:35.091331 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f1cbca5b-1dcd-4dae-a16d-9be63d036283 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:35.097549 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f1cbca5b-1dcd-4dae-a16d-9be63d036283 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:35.098026 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f1cbca5b-1dcd-4dae-a16d-9be63d036283 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:35.099305 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f1cbca5b-1dcd-4dae-a16d-9be63d036283 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:35.099737 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f1cbca5b-1dcd-4dae-a16d-9be63d036283 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:35.168873 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f1cbca5b-1dcd-4dae-a16d-9be63d036283 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:35.176796 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f1cbca5b-1dcd-4dae-a16d-9be63d036283 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.090138 Apr 12 15:18:35.178140 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 745/1514] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:35 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:36.195227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-45d2bb54-3161-4d9e-88d4-9594420ff15e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:36.195833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-45d2bb54-3161-4d9e-88d4-9594420ff15e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:36.202386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45d2bb54-3161-4d9e-88d4-9594420ff15e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:36.202840 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45d2bb54-3161-4d9e-88d4-9594420ff15e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:36.203621 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45d2bb54-3161-4d9e-88d4-9594420ff15e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:36.204053 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-45d2bb54-3161-4d9e-88d4-9594420ff15e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:36.265130 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-45d2bb54-3161-4d9e-88d4-9594420ff15e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:36.273542 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-45d2bb54-3161-4d9e-88d4-9594420ff15e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082834 Apr 12 15:18:36.274168 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 770/1515] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:36 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:37.291409 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3b166ca1-dd44-4a3a-8e4d-8309be8db127 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:37.292019 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3b166ca1-dd44-4a3a-8e4d-8309be8db127 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:37.299424 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3b166ca1-dd44-4a3a-8e4d-8309be8db127 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:37.299860 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3b166ca1-dd44-4a3a-8e4d-8309be8db127 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:37.300626 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3b166ca1-dd44-4a3a-8e4d-8309be8db127 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:37.301050 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3b166ca1-dd44-4a3a-8e4d-8309be8db127 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:37.364704 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-3b166ca1-dd44-4a3a-8e4d-8309be8db127 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:37.372851 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3b166ca1-dd44-4a3a-8e4d-8309be8db127 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.085261 Apr 12 15:18:37.373475 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 746/1516] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:37 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:18:38.390345 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-11e834b7-6606-4733-8c90-7fea724d610f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:38.390932 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-11e834b7-6606-4733-8c90-7fea724d610f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:38.397289 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11e834b7-6606-4733-8c90-7fea724d610f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:38.397765 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11e834b7-6606-4733-8c90-7fea724d610f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:38.398532 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11e834b7-6606-4733-8c90-7fea724d610f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:38.398961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-11e834b7-6606-4733-8c90-7fea724d610f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:38.460323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-11e834b7-6606-4733-8c90-7fea724d610f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:38.468509 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-11e834b7-6606-4733-8c90-7fea724d610f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081954 Apr 12 15:18:38.469097 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 771/1517] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:38 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:39.486089 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-f9c176ff-465f-4f04-b417-660d3575468f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:39.486683 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-f9c176ff-465f-4f04-b417-660d3575468f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:39.493168 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9c176ff-465f-4f04-b417-660d3575468f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:39.493654 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9c176ff-465f-4f04-b417-660d3575468f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:39.494398 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9c176ff-465f-4f04-b417-660d3575468f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:39.494823 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-f9c176ff-465f-4f04-b417-660d3575468f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:39.557663 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-f9c176ff-465f-4f04-b417-660d3575468f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:39.565553 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-f9c176ff-465f-4f04-b417-660d3575468f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.083321 Apr 12 15:18:39.566155 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 747/1518] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:39 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:40.583881 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-721b0dd5-02d1-4d42-a525-4ed9db9b3491 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:40.584471 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-721b0dd5-02d1-4d42-a525-4ed9db9b3491 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:40.592549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-721b0dd5-02d1-4d42-a525-4ed9db9b3491 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:40.592993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-721b0dd5-02d1-4d42-a525-4ed9db9b3491 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:40.593794 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-721b0dd5-02d1-4d42-a525-4ed9db9b3491 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:40.594227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-721b0dd5-02d1-4d42-a525-4ed9db9b3491 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:40.655949 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-721b0dd5-02d1-4d42-a525-4ed9db9b3491 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:40.664127 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-721b0dd5-02d1-4d42-a525-4ed9db9b3491 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.086156 Apr 12 15:18:40.664683 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 772/1519] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:40 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:41.680633 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-7560c3c7-877b-4e16-b1a5-8c5875cf53f5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:41.681174 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-7560c3c7-877b-4e16-b1a5-8c5875cf53f5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:41.687487 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7560c3c7-877b-4e16-b1a5-8c5875cf53f5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:41.687937 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7560c3c7-877b-4e16-b1a5-8c5875cf53f5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:41.688701 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7560c3c7-877b-4e16-b1a5-8c5875cf53f5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:41.689135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-7560c3c7-877b-4e16-b1a5-8c5875cf53f5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:41.753173 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-7560c3c7-877b-4e16-b1a5-8c5875cf53f5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:41.761532 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-7560c3c7-877b-4e16-b1a5-8c5875cf53f5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.085130 Apr 12 15:18:41.762135 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 748/1520] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:41 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:42.781761 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b82fd4b7-6870-4c6d-8068-005aa8d13b29 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:42.782349 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b82fd4b7-6870-4c6d-8068-005aa8d13b29 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:42.789837 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b82fd4b7-6870-4c6d-8068-005aa8d13b29 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:42.790288 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b82fd4b7-6870-4c6d-8068-005aa8d13b29 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:42.791062 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b82fd4b7-6870-4c6d-8068-005aa8d13b29 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:42.791777 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b82fd4b7-6870-4c6d-8068-005aa8d13b29 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:42.852894 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b82fd4b7-6870-4c6d-8068-005aa8d13b29 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:42.860872 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b82fd4b7-6870-4c6d-8068-005aa8d13b29 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.084155 Apr 12 15:18:42.861425 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 773/1521] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:42 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:43.878151 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-25e130dd-6aa6-4c5b-baeb-c16c76d8a8a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:43.878744 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-25e130dd-6aa6-4c5b-baeb-c16c76d8a8a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:43.885221 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-25e130dd-6aa6-4c5b-baeb-c16c76d8a8a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:43.885687 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-25e130dd-6aa6-4c5b-baeb-c16c76d8a8a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:43.886443 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-25e130dd-6aa6-4c5b-baeb-c16c76d8a8a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:43.886867 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-25e130dd-6aa6-4c5b-baeb-c16c76d8a8a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:43.945594 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-25e130dd-6aa6-4c5b-baeb-c16c76d8a8a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:43.953374 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-25e130dd-6aa6-4c5b-baeb-c16c76d8a8a2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079077 Apr 12 15:18:43.953965 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 749/1522] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:43 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:44.971255 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fc3ff9de-7d3a-40c9-9f7c-25407ad9ea2a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:44.971859 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fc3ff9de-7d3a-40c9-9f7c-25407ad9ea2a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:44.978916 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc3ff9de-7d3a-40c9-9f7c-25407ad9ea2a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:44.979397 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc3ff9de-7d3a-40c9-9f7c-25407ad9ea2a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:44.980166 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc3ff9de-7d3a-40c9-9f7c-25407ad9ea2a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:44.980598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fc3ff9de-7d3a-40c9-9f7c-25407ad9ea2a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:45.055086 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fc3ff9de-7d3a-40c9-9f7c-25407ad9ea2a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:45.062928 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fc3ff9de-7d3a-40c9-9f7c-25407ad9ea2a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.095525 Apr 12 15:18:45.063482 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 774/1523] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:44 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:46.079934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-47e90378-36c3-4a80-815e-ed11009902f8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:46.080585 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-47e90378-36c3-4a80-815e-ed11009902f8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:46.087560 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47e90378-36c3-4a80-815e-ed11009902f8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:46.088045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47e90378-36c3-4a80-815e-ed11009902f8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:46.088815 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47e90378-36c3-4a80-815e-ed11009902f8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:46.089251 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-47e90378-36c3-4a80-815e-ed11009902f8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:46.153103 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-47e90378-36c3-4a80-815e-ed11009902f8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:46.161459 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-47e90378-36c3-4a80-815e-ed11009902f8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.085267 Apr 12 15:18:46.162199 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 750/1524] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:46 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:47.179162 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-3f8a00ba-7c89-473e-91f6-c5b4572661df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:47.179763 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-3f8a00ba-7c89-473e-91f6-c5b4572661df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:47.186036 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f8a00ba-7c89-473e-91f6-c5b4572661df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:47.186481 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f8a00ba-7c89-473e-91f6-c5b4572661df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:47.187227 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f8a00ba-7c89-473e-91f6-c5b4572661df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:47.187650 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-3f8a00ba-7c89-473e-91f6-c5b4572661df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:47.247610 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-3f8a00ba-7c89-473e-91f6-c5b4572661df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:47.256207 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-3f8a00ba-7c89-473e-91f6-c5b4572661df tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081518 Apr 12 15:18:47.256764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 775/1525] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:47 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:48.273124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9c9005fe-e103-472e-aa4e-24575183745a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:48.273809 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9c9005fe-e103-472e-aa4e-24575183745a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:48.280149 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c9005fe-e103-472e-aa4e-24575183745a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:48.280596 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c9005fe-e103-472e-aa4e-24575183745a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:48.281363 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c9005fe-e103-472e-aa4e-24575183745a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:48.281826 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9c9005fe-e103-472e-aa4e-24575183745a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:48.341114 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9c9005fe-e103-472e-aa4e-24575183745a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:48.349599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9c9005fe-e103-472e-aa4e-24575183745a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.080480 Apr 12 15:18:48.350203 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 751/1526] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:48 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:49.367651 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-92770819-525b-4c7a-a2d9-9cd01b69007d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:49.368262 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-92770819-525b-4c7a-a2d9-9cd01b69007d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:49.374550 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-92770819-525b-4c7a-a2d9-9cd01b69007d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:49.374992 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-92770819-525b-4c7a-a2d9-9cd01b69007d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:49.375744 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-92770819-525b-4c7a-a2d9-9cd01b69007d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:49.376170 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-92770819-525b-4c7a-a2d9-9cd01b69007d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:49.438673 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-92770819-525b-4c7a-a2d9-9cd01b69007d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:49.446890 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-92770819-525b-4c7a-a2d9-9cd01b69007d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.084198 Apr 12 15:18:49.447448 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 776/1527] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:49 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:50.464507 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-bba1a5ba-b63b-4afb-8e91-1104d0668752 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:50.465124 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-bba1a5ba-b63b-4afb-8e91-1104d0668752 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:50.471109 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bba1a5ba-b63b-4afb-8e91-1104d0668752 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:50.471549 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bba1a5ba-b63b-4afb-8e91-1104d0668752 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:50.472304 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bba1a5ba-b63b-4afb-8e91-1104d0668752 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:50.472735 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-bba1a5ba-b63b-4afb-8e91-1104d0668752 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:50.536867 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-bba1a5ba-b63b-4afb-8e91-1104d0668752 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:50.545035 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-bba1a5ba-b63b-4afb-8e91-1104d0668752 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.084481 Apr 12 15:18:50.545756 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 752/1528] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:50 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:51.562179 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4548a7e7-d98a-4b44-90ca-813881417023 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:51.562782 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4548a7e7-d98a-4b44-90ca-813881417023 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:51.569836 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4548a7e7-d98a-4b44-90ca-813881417023 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:51.570292 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4548a7e7-d98a-4b44-90ca-813881417023 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:51.571026 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4548a7e7-d98a-4b44-90ca-813881417023 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:51.571663 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4548a7e7-d98a-4b44-90ca-813881417023 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:51.632403 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4548a7e7-d98a-4b44-90ca-813881417023 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:51.640343 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4548a7e7-d98a-4b44-90ca-813881417023 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081988 Apr 12 15:18:51.640895 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 777/1529] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:51 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:52.656413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-35aacd20-ae9e-4bca-ab71-ffbac5b50254 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:52.657051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-35aacd20-ae9e-4bca-ab71-ffbac5b50254 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:52.664236 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35aacd20-ae9e-4bca-ab71-ffbac5b50254 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:52.664680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35aacd20-ae9e-4bca-ab71-ffbac5b50254 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:52.665448 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35aacd20-ae9e-4bca-ab71-ffbac5b50254 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:52.665916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-35aacd20-ae9e-4bca-ab71-ffbac5b50254 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:52.726147 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-35aacd20-ae9e-4bca-ab71-ffbac5b50254 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:52.733994 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-35aacd20-ae9e-4bca-ab71-ffbac5b50254 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081492 Apr 12 15:18:52.734565 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 753/1530] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:52 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:53.750959 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a7d27e02-766d-485f-a962-bf920676f776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:53.751555 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a7d27e02-766d-485f-a962-bf920676f776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:53.758056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7d27e02-766d-485f-a962-bf920676f776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:53.758498 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7d27e02-766d-485f-a962-bf920676f776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:53.759256 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7d27e02-766d-485f-a962-bf920676f776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:53.759743 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a7d27e02-766d-485f-a962-bf920676f776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:53.819877 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a7d27e02-766d-485f-a962-bf920676f776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:53.827595 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a7d27e02-766d-485f-a962-bf920676f776 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.080513 Apr 12 15:18:53.828162 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 778/1531] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:53 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:54.844902 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-32dc08f9-a785-4e83-a055-f7b1da144756 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:54.845495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-32dc08f9-a785-4e83-a055-f7b1da144756 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:54.851933 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32dc08f9-a785-4e83-a055-f7b1da144756 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:54.852381 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32dc08f9-a785-4e83-a055-f7b1da144756 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:54.853165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32dc08f9-a785-4e83-a055-f7b1da144756 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:54.853596 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32dc08f9-a785-4e83-a055-f7b1da144756 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:54.924212 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-32dc08f9-a785-4e83-a055-f7b1da144756 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:54.933126 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-32dc08f9-a785-4e83-a055-f7b1da144756 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.092229 Apr 12 15:18:54.933733 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 754/1532] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:54 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:55.950327 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7e922da8-a848-41af-a357-41d4d9d5f8b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:55.950918 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7e922da8-a848-41af-a357-41d4d9d5f8b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:55.957712 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e922da8-a848-41af-a357-41d4d9d5f8b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:55.958111 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e922da8-a848-41af-a357-41d4d9d5f8b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:55.958873 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e922da8-a848-41af-a357-41d4d9d5f8b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:55.959296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7e922da8-a848-41af-a357-41d4d9d5f8b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:56.018573 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7e922da8-a848-41af-a357-41d4d9d5f8b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:56.027129 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7e922da8-a848-41af-a357-41d4d9d5f8b5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.080821 Apr 12 15:18:56.027687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 779/1533] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:55 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:57.044892 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-a9d563f0-1133-4508-a45b-2cfddc1870f1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:57.045481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-a9d563f0-1133-4508-a45b-2cfddc1870f1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:57.052476 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a9d563f0-1133-4508-a45b-2cfddc1870f1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:57.052928 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a9d563f0-1133-4508-a45b-2cfddc1870f1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:57.053719 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a9d563f0-1133-4508-a45b-2cfddc1870f1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:57.054153 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-a9d563f0-1133-4508-a45b-2cfddc1870f1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:57.115608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-a9d563f0-1133-4508-a45b-2cfddc1870f1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:57.123391 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-a9d563f0-1133-4508-a45b-2cfddc1870f1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082304 Apr 12 15:18:57.125882 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 755/1534] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:57 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:58.140467 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-905cb6d2-2cdc-4b8c-b490-f0d957c4fd63 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:58.141096 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-905cb6d2-2cdc-4b8c-b490-f0d957c4fd63 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:58.148318 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-905cb6d2-2cdc-4b8c-b490-f0d957c4fd63 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:58.148766 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-905cb6d2-2cdc-4b8c-b490-f0d957c4fd63 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:58.149533 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-905cb6d2-2cdc-4b8c-b490-f0d957c4fd63 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:58.150359 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-905cb6d2-2cdc-4b8c-b490-f0d957c4fd63 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:58.214073 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-905cb6d2-2cdc-4b8c-b490-f0d957c4fd63 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:58.221776 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-905cb6d2-2cdc-4b8c-b490-f0d957c4fd63 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.085180 Apr 12 15:18:58.222567 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 780/1535] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:58 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:18:59.240239 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6aaf5b16-669c-40f1-a73f-83cb22371864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:18:59.240842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6aaf5b16-669c-40f1-a73f-83cb22371864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:18:59.247511 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6aaf5b16-669c-40f1-a73f-83cb22371864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:59.247959 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6aaf5b16-669c-40f1-a73f-83cb22371864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:59.248738 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6aaf5b16-669c-40f1-a73f-83cb22371864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:18:59.249170 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6aaf5b16-669c-40f1-a73f-83cb22371864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:18:59.313608 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6aaf5b16-669c-40f1-a73f-83cb22371864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:18:59.322320 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6aaf5b16-669c-40f1-a73f-83cb22371864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.086662 Apr 12 15:18:59.322899 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 756/1536] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:18:59 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:00.339866 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e367c4b3-9338-4b29-8969-a97b6fd88fae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:00.340474 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e367c4b3-9338-4b29-8969-a97b6fd88fae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:00.346878 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e367c4b3-9338-4b29-8969-a97b6fd88fae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:00.347322 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e367c4b3-9338-4b29-8969-a97b6fd88fae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:00.348508 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e367c4b3-9338-4b29-8969-a97b6fd88fae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:00.348668 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e367c4b3-9338-4b29-8969-a97b6fd88fae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:00.410931 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e367c4b3-9338-4b29-8969-a97b6fd88fae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:00.418847 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e367c4b3-9338-4b29-8969-a97b6fd88fae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082860 Apr 12 15:19:00.419416 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 781/1537] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:00 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:01.436093 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-104754ad-424e-436f-821f-0c40c7113300 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:01.436686 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-104754ad-424e-436f-821f-0c40c7113300 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:01.443232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-104754ad-424e-436f-821f-0c40c7113300 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:01.443681 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-104754ad-424e-436f-821f-0c40c7113300 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:01.444453 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-104754ad-424e-436f-821f-0c40c7113300 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:01.444887 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-104754ad-424e-436f-821f-0c40c7113300 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:01.504910 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-104754ad-424e-436f-821f-0c40c7113300 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:01.512763 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-104754ad-424e-436f-821f-0c40c7113300 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.080594 Apr 12 15:19:01.513330 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 757/1538] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:01 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:02.530930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-871c3d58-ba1a-485e-9dd7-7b7fe1a57f7c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:02.532152 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-871c3d58-ba1a-485e-9dd7-7b7fe1a57f7c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:02.543930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-871c3d58-ba1a-485e-9dd7-7b7fe1a57f7c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:02.543930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-871c3d58-ba1a-485e-9dd7-7b7fe1a57f7c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:02.543930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-871c3d58-ba1a-485e-9dd7-7b7fe1a57f7c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:02.543930 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-871c3d58-ba1a-485e-9dd7-7b7fe1a57f7c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:02.603487 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-871c3d58-ba1a-485e-9dd7-7b7fe1a57f7c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:02.612001 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-871c3d58-ba1a-485e-9dd7-7b7fe1a57f7c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.084890 Apr 12 15:19:02.612584 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 782/1539] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:02 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:03.630716 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6a5bae97-9e9e-4eda-b303-21c21850411b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:03.631383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6a5bae97-9e9e-4eda-b303-21c21850411b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:03.637776 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a5bae97-9e9e-4eda-b303-21c21850411b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:03.638226 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a5bae97-9e9e-4eda-b303-21c21850411b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:03.638997 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a5bae97-9e9e-4eda-b303-21c21850411b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:03.639430 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6a5bae97-9e9e-4eda-b303-21c21850411b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:03.715665 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6a5bae97-9e9e-4eda-b303-21c21850411b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:03.723884 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6a5bae97-9e9e-4eda-b303-21c21850411b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.097648 Apr 12 15:19:03.724420 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 758/1540] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:03 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 15:19:04.741137 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-db672b2d-8cb5-49b2-8abf-ee1a7ff787f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:04.741811 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-db672b2d-8cb5-49b2-8abf-ee1a7ff787f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:04.748098 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-db672b2d-8cb5-49b2-8abf-ee1a7ff787f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:04.748538 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-db672b2d-8cb5-49b2-8abf-ee1a7ff787f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:04.749284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-db672b2d-8cb5-49b2-8abf-ee1a7ff787f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:04.749736 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-db672b2d-8cb5-49b2-8abf-ee1a7ff787f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:04.813861 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-db672b2d-8cb5-49b2-8abf-ee1a7ff787f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:04.828165 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-db672b2d-8cb5-49b2-8abf-ee1a7ff787f2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.091050 Apr 12 15:19:04.829171 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 783/1541] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:04 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:05.846068 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-199027b2-4013-4eb6-9e28-c6630e64bf1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:05.846707 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-199027b2-4013-4eb6-9e28-c6630e64bf1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:05.853920 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-199027b2-4013-4eb6-9e28-c6630e64bf1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:05.854360 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-199027b2-4013-4eb6-9e28-c6630e64bf1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:05.855112 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-199027b2-4013-4eb6-9e28-c6630e64bf1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:05.855533 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-199027b2-4013-4eb6-9e28-c6630e64bf1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:05.916283 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-199027b2-4013-4eb6-9e28-c6630e64bf1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:05.924065 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-199027b2-4013-4eb6-9e28-c6630e64bf1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081815 Apr 12 15:19:05.924627 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 759/1542] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:05 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:06.940785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c5ec1b2e-e228-4b60-8a89-8546869c739a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:06.941362 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c5ec1b2e-e228-4b60-8a89-8546869c739a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:06.947849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5ec1b2e-e228-4b60-8a89-8546869c739a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:06.948296 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5ec1b2e-e228-4b60-8a89-8546869c739a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:06.949056 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5ec1b2e-e228-4b60-8a89-8546869c739a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:06.949484 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5ec1b2e-e228-4b60-8a89-8546869c739a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:07.024118 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c5ec1b2e-e228-4b60-8a89-8546869c739a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:07.031807 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c5ec1b2e-e228-4b60-8a89-8546869c739a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.094937 Apr 12 15:19:07.032364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 784/1543] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:06 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:08.051271 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b134706d-cdd9-4169-a2fc-c60ae7eb2543 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:08.051914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b134706d-cdd9-4169-a2fc-c60ae7eb2543 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:08.058427 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b134706d-cdd9-4169-a2fc-c60ae7eb2543 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:08.058879 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b134706d-cdd9-4169-a2fc-c60ae7eb2543 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:08.059658 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b134706d-cdd9-4169-a2fc-c60ae7eb2543 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:08.060093 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b134706d-cdd9-4169-a2fc-c60ae7eb2543 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:08.124167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b134706d-cdd9-4169-a2fc-c60ae7eb2543 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:08.132228 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b134706d-cdd9-4169-a2fc-c60ae7eb2543 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.087098 Apr 12 15:19:08.132792 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 760/1544] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:08 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:09.149278 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-cfddf08d-3872-48c2-92fc-b6739c5e1e17 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:09.149915 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-cfddf08d-3872-48c2-92fc-b6739c5e1e17 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:09.156539 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfddf08d-3872-48c2-92fc-b6739c5e1e17 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:09.156978 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfddf08d-3872-48c2-92fc-b6739c5e1e17 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:09.157778 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfddf08d-3872-48c2-92fc-b6739c5e1e17 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:09.158202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-cfddf08d-3872-48c2-92fc-b6739c5e1e17 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:09.220339 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-cfddf08d-3872-48c2-92fc-b6739c5e1e17 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:09.229133 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-cfddf08d-3872-48c2-92fc-b6739c5e1e17 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.084548 Apr 12 15:19:09.229736 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 785/1545] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:09 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:10.251077 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-07df7e7c-2309-4729-b0ff-77b9ef809ef2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:10.251698 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-07df7e7c-2309-4729-b0ff-77b9ef809ef2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:10.259615 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-07df7e7c-2309-4729-b0ff-77b9ef809ef2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:10.260289 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-07df7e7c-2309-4729-b0ff-77b9ef809ef2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:10.261287 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-07df7e7c-2309-4729-b0ff-77b9ef809ef2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:10.262070 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-07df7e7c-2309-4729-b0ff-77b9ef809ef2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:10.337004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-07df7e7c-2309-4729-b0ff-77b9ef809ef2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:10.345154 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-07df7e7c-2309-4729-b0ff-77b9ef809ef2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.102020 Apr 12 15:19:10.345781 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 761/1546] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:10 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:11.365508 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c5b7e478-5047-40c4-a792-91bbc409751a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:11.366234 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c5b7e478-5047-40c4-a792-91bbc409751a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:11.372804 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5b7e478-5047-40c4-a792-91bbc409751a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:11.373252 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5b7e478-5047-40c4-a792-91bbc409751a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:11.374072 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5b7e478-5047-40c4-a792-91bbc409751a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:11.374502 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c5b7e478-5047-40c4-a792-91bbc409751a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:11.436592 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c5b7e478-5047-40c4-a792-91bbc409751a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:11.445711 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c5b7e478-5047-40c4-a792-91bbc409751a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.084752 Apr 12 15:19:11.446299 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 786/1547] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:11 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:12.462512 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d85c21f9-035e-43a1-aa7b-813fd64a48cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:12.463134 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d85c21f9-035e-43a1-aa7b-813fd64a48cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:12.469464 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85c21f9-035e-43a1-aa7b-813fd64a48cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:12.469946 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85c21f9-035e-43a1-aa7b-813fd64a48cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:12.470717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85c21f9-035e-43a1-aa7b-813fd64a48cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:12.471145 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d85c21f9-035e-43a1-aa7b-813fd64a48cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:12.538846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d85c21f9-035e-43a1-aa7b-813fd64a48cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:12.547241 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d85c21f9-035e-43a1-aa7b-813fd64a48cc tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.088575 Apr 12 15:19:12.547831 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 762/1548] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:12 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:13.565947 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e2de00fc-d8a4-4d05-aa2f-4ea79300f019 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:13.566693 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e2de00fc-d8a4-4d05-aa2f-4ea79300f019 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:13.573088 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2de00fc-d8a4-4d05-aa2f-4ea79300f019 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:13.577124 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2de00fc-d8a4-4d05-aa2f-4ea79300f019 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:13.577124 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2de00fc-d8a4-4d05-aa2f-4ea79300f019 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:13.577124 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e2de00fc-d8a4-4d05-aa2f-4ea79300f019 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:13.635543 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e2de00fc-d8a4-4d05-aa2f-4ea79300f019 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:13.643471 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e2de00fc-d8a4-4d05-aa2f-4ea79300f019 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081451 Apr 12 15:19:13.644524 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 787/1549] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:13 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:14.661132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-cea0cb65-ddaa-40ce-a38f-ffe21e28539f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:14.661934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cea0cb65-ddaa-40ce-a38f-ffe21e28539f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:14.668050 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cea0cb65-ddaa-40ce-a38f-ffe21e28539f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:14.668576 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cea0cb65-ddaa-40ce-a38f-ffe21e28539f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:14.669389 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cea0cb65-ddaa-40ce-a38f-ffe21e28539f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:14.669951 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cea0cb65-ddaa-40ce-a38f-ffe21e28539f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:14.730725 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-cea0cb65-ddaa-40ce-a38f-ffe21e28539f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:14.739610 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-cea0cb65-ddaa-40ce-a38f-ffe21e28539f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.083100 Apr 12 15:19:14.740198 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 763/1550] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:14 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:15.757077 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-38c6cebc-dd9e-4600-89d7-afc438d7ed22 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:15.757705 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-38c6cebc-dd9e-4600-89d7-afc438d7ed22 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:15.763923 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38c6cebc-dd9e-4600-89d7-afc438d7ed22 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:15.764364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38c6cebc-dd9e-4600-89d7-afc438d7ed22 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:15.765120 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38c6cebc-dd9e-4600-89d7-afc438d7ed22 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:15.765549 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-38c6cebc-dd9e-4600-89d7-afc438d7ed22 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:15.823916 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-38c6cebc-dd9e-4600-89d7-afc438d7ed22 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:15.831534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-38c6cebc-dd9e-4600-89d7-afc438d7ed22 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.078889 Apr 12 15:19:15.832106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 788/1551] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:15 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:16.848422 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-2507ed7f-fdaa-4a60-bba8-c033716a9109 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:16.848996 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-2507ed7f-fdaa-4a60-bba8-c033716a9109 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:16.855270 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2507ed7f-fdaa-4a60-bba8-c033716a9109 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:16.855714 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2507ed7f-fdaa-4a60-bba8-c033716a9109 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:16.856460 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2507ed7f-fdaa-4a60-bba8-c033716a9109 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:16.856890 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-2507ed7f-fdaa-4a60-bba8-c033716a9109 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:16.918832 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-2507ed7f-fdaa-4a60-bba8-c033716a9109 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:16.927020 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-2507ed7f-fdaa-4a60-bba8-c033716a9109 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082609 Apr 12 15:19:16.927587 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 764/1552] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:16 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:17.945583 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-a754ec40-ff05-49e3-ba97-6f2b26581864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:17.946162 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-a754ec40-ff05-49e3-ba97-6f2b26581864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:17.952514 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a754ec40-ff05-49e3-ba97-6f2b26581864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:17.952956 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a754ec40-ff05-49e3-ba97-6f2b26581864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:17.953749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a754ec40-ff05-49e3-ba97-6f2b26581864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:17.954215 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-a754ec40-ff05-49e3-ba97-6f2b26581864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:18.014366 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-a754ec40-ff05-49e3-ba97-6f2b26581864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:18.022347 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-a754ec40-ff05-49e3-ba97-6f2b26581864 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081350 Apr 12 15:19:18.022903 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 789/1553] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:17 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:19.040207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-dd68e463-83cc-4caf-b4ce-f1950e00725e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:19.040858 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-dd68e463-83cc-4caf-b4ce-f1950e00725e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:19.046656 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd68e463-83cc-4caf-b4ce-f1950e00725e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:19.047099 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd68e463-83cc-4caf-b4ce-f1950e00725e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:19.047852 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd68e463-83cc-4caf-b4ce-f1950e00725e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:19.048286 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-dd68e463-83cc-4caf-b4ce-f1950e00725e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:19.185943 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-dd68e463-83cc-4caf-b4ce-f1950e00725e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:19.194322 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-dd68e463-83cc-4caf-b4ce-f1950e00725e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.158141 Apr 12 15:19:19.194898 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 765/1554] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:19 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:20.211483 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9f2e7866-f24b-4298-ad36-480551aa494c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:20.212115 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9f2e7866-f24b-4298-ad36-480551aa494c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:20.218132 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f2e7866-f24b-4298-ad36-480551aa494c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:20.218572 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f2e7866-f24b-4298-ad36-480551aa494c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:20.219323 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f2e7866-f24b-4298-ad36-480551aa494c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:20.219750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9f2e7866-f24b-4298-ad36-480551aa494c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:20.488410 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9f2e7866-f24b-4298-ad36-480551aa494c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:20.496001 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9f2e7866-f24b-4298-ad36-480551aa494c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.288859 Apr 12 15:19:20.496551 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 790/1555] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:20 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:21.512394 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-159ae378-0ef4-4760-ad4e-904b3ec177e3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:21.512961 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-159ae378-0ef4-4760-ad4e-904b3ec177e3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:21.519869 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-159ae378-0ef4-4760-ad4e-904b3ec177e3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:21.520318 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-159ae378-0ef4-4760-ad4e-904b3ec177e3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:21.521087 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-159ae378-0ef4-4760-ad4e-904b3ec177e3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:21.521520 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-159ae378-0ef4-4760-ad4e-904b3ec177e3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:21.584661 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-159ae378-0ef4-4760-ad4e-904b3ec177e3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:21.592728 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-159ae378-0ef4-4760-ad4e-904b3ec177e3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.084364 Apr 12 15:19:21.593275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 766/1556] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:21 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:22.610512 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b1893d93-cac2-472d-b522-88a577d8081f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:22.611039 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b1893d93-cac2-472d-b522-88a577d8081f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:22.617791 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1893d93-cac2-472d-b522-88a577d8081f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:22.618233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1893d93-cac2-472d-b522-88a577d8081f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:22.618980 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1893d93-cac2-472d-b522-88a577d8081f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:22.619402 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b1893d93-cac2-472d-b522-88a577d8081f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:22.679171 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b1893d93-cac2-472d-b522-88a577d8081f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:22.687204 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b1893d93-cac2-472d-b522-88a577d8081f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.080576 Apr 12 15:19:22.687760 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 791/1557] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:22 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:23.704315 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4ae9e8c8-77ec-4c5b-b5ee-19ab05d858f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:23.704867 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4ae9e8c8-77ec-4c5b-b5ee-19ab05d858f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:23.711803 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ae9e8c8-77ec-4c5b-b5ee-19ab05d858f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:23.712253 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ae9e8c8-77ec-4c5b-b5ee-19ab05d858f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:23.713012 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ae9e8c8-77ec-4c5b-b5ee-19ab05d858f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:23.713444 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4ae9e8c8-77ec-4c5b-b5ee-19ab05d858f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:23.772302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4ae9e8c8-77ec-4c5b-b5ee-19ab05d858f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:23.780203 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4ae9e8c8-77ec-4c5b-b5ee-19ab05d858f4 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079792 Apr 12 15:19:23.780766 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 767/1558] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:23 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:24.797304 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0eac46f6-c945-4947-9681-fba66e1128a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:24.797921 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0eac46f6-c945-4947-9681-fba66e1128a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:24.804326 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0eac46f6-c945-4947-9681-fba66e1128a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:24.804772 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0eac46f6-c945-4947-9681-fba66e1128a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:24.805530 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0eac46f6-c945-4947-9681-fba66e1128a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:24.805988 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0eac46f6-c945-4947-9681-fba66e1128a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:24.863386 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0eac46f6-c945-4947-9681-fba66e1128a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:24.871067 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0eac46f6-c945-4947-9681-fba66e1128a5 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.077619 Apr 12 15:19:24.871612 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 792/1559] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:24 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:25.888193 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-8312f205-157d-464b-b79c-c5e9bd23cfe7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:25.888803 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-8312f205-157d-464b-b79c-c5e9bd23cfe7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:25.895294 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8312f205-157d-464b-b79c-c5e9bd23cfe7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:25.895754 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8312f205-157d-464b-b79c-c5e9bd23cfe7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:25.896524 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8312f205-157d-464b-b79c-c5e9bd23cfe7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:25.896960 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-8312f205-157d-464b-b79c-c5e9bd23cfe7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:25.959184 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-8312f205-157d-464b-b79c-c5e9bd23cfe7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:25.967014 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-8312f205-157d-464b-b79c-c5e9bd23cfe7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082685 Apr 12 15:19:25.967595 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 768/1560] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:25 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:26.985109 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b2f68fbb-5dbb-40ed-b671-ec327ee9268f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:26.985730 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b2f68fbb-5dbb-40ed-b671-ec327ee9268f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:26.992407 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b2f68fbb-5dbb-40ed-b671-ec327ee9268f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:26.992855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b2f68fbb-5dbb-40ed-b671-ec327ee9268f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:26.993655 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b2f68fbb-5dbb-40ed-b671-ec327ee9268f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:26.994098 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b2f68fbb-5dbb-40ed-b671-ec327ee9268f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:27.056803 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b2f68fbb-5dbb-40ed-b671-ec327ee9268f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:27.064687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b2f68fbb-5dbb-40ed-b671-ec327ee9268f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.083695 Apr 12 15:19:27.065269 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 793/1561] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:26 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:28.082232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4285e882-1164-4a17-8760-605bd7ccafd2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:28.082842 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4285e882-1164-4a17-8760-605bd7ccafd2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:28.088997 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4285e882-1164-4a17-8760-605bd7ccafd2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:28.089445 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4285e882-1164-4a17-8760-605bd7ccafd2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:28.090253 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4285e882-1164-4a17-8760-605bd7ccafd2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:28.090685 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4285e882-1164-4a17-8760-605bd7ccafd2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:28.151763 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4285e882-1164-4a17-8760-605bd7ccafd2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:28.159914 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4285e882-1164-4a17-8760-605bd7ccafd2 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082149 Apr 12 15:19:28.160481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 769/1562] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:28 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:29.176800 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f5752197-9e32-4838-93de-c4a0a875c076 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:29.177364 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f5752197-9e32-4838-93de-c4a0a875c076 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:29.183666 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5752197-9e32-4838-93de-c4a0a875c076 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:29.184111 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5752197-9e32-4838-93de-c4a0a875c076 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:29.184875 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5752197-9e32-4838-93de-c4a0a875c076 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:29.185305 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f5752197-9e32-4838-93de-c4a0a875c076 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:29.246557 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f5752197-9e32-4838-93de-c4a0a875c076 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:29.254327 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f5752197-9e32-4838-93de-c4a0a875c076 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081823 Apr 12 15:19:29.254881 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 794/1563] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:29 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:30.271400 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-98079b6e-92e6-4c50-a0c0-38f3197d8e9a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:30.272036 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-98079b6e-92e6-4c50-a0c0-38f3197d8e9a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:30.278329 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-98079b6e-92e6-4c50-a0c0-38f3197d8e9a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:30.278782 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-98079b6e-92e6-4c50-a0c0-38f3197d8e9a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:30.279544 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-98079b6e-92e6-4c50-a0c0-38f3197d8e9a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:30.279977 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-98079b6e-92e6-4c50-a0c0-38f3197d8e9a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:30.340853 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-98079b6e-92e6-4c50-a0c0-38f3197d8e9a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:30.348815 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-98079b6e-92e6-4c50-a0c0-38f3197d8e9a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081850 Apr 12 15:19:30.349391 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 770/1564] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:30 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:31.366457 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-bc3828f8-6db8-4f1b-addd-f29adb430477 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:31.367079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-bc3828f8-6db8-4f1b-addd-f29adb430477 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:31.373275 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc3828f8-6db8-4f1b-addd-f29adb430477 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:31.373749 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc3828f8-6db8-4f1b-addd-f29adb430477 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:31.374500 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc3828f8-6db8-4f1b-addd-f29adb430477 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:31.374925 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-bc3828f8-6db8-4f1b-addd-f29adb430477 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:31.436960 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-bc3828f8-6db8-4f1b-addd-f29adb430477 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:31.445200 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-bc3828f8-6db8-4f1b-addd-f29adb430477 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.083242 Apr 12 15:19:31.446025 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 795/1565] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:31 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:32.462847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e45eab91-ee0d-4337-8ab2-daee7c78ef6b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:32.463557 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e45eab91-ee0d-4337-8ab2-daee7c78ef6b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:32.470015 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e45eab91-ee0d-4337-8ab2-daee7c78ef6b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:32.470465 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e45eab91-ee0d-4337-8ab2-daee7c78ef6b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:32.471351 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e45eab91-ee0d-4337-8ab2-daee7c78ef6b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:32.472701 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e45eab91-ee0d-4337-8ab2-daee7c78ef6b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:32.532211 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e45eab91-ee0d-4337-8ab2-daee7c78ef6b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:32.539923 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e45eab91-ee0d-4337-8ab2-daee7c78ef6b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.080902 Apr 12 15:19:32.548886 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 771/1566] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:32 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:33.556809 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b8ed0315-f713-4ef3-8ff4-f5cd38ed165d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:33.560271 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b8ed0315-f713-4ef3-8ff4-f5cd38ed165d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:33.563931 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8ed0315-f713-4ef3-8ff4-f5cd38ed165d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:33.564755 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8ed0315-f713-4ef3-8ff4-f5cd38ed165d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:33.566062 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8ed0315-f713-4ef3-8ff4-f5cd38ed165d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:33.566496 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8ed0315-f713-4ef3-8ff4-f5cd38ed165d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:33.627276 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b8ed0315-f713-4ef3-8ff4-f5cd38ed165d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:33.635614 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b8ed0315-f713-4ef3-8ff4-f5cd38ed165d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082763 Apr 12 15:19:33.636166 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 796/1567] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:33 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:34.653110 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9fee0d96-d002-475a-be07-edd83a7471ae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:34.653750 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9fee0d96-d002-475a-be07-edd83a7471ae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:34.660338 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9fee0d96-d002-475a-be07-edd83a7471ae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:34.660784 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9fee0d96-d002-475a-be07-edd83a7471ae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:34.661552 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9fee0d96-d002-475a-be07-edd83a7471ae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:34.662011 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9fee0d96-d002-475a-be07-edd83a7471ae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:34.723562 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-9fee0d96-d002-475a-be07-edd83a7471ae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:34.731268 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9fee0d96-d002-475a-be07-edd83a7471ae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082004 Apr 12 15:19:34.734610 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 772/1568] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:34 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:35.748470 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d4446769-d027-4b56-b68a-a19a723ae4a6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:35.749079 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d4446769-d027-4b56-b68a-a19a723ae4a6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:35.755868 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4446769-d027-4b56-b68a-a19a723ae4a6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:35.756309 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4446769-d027-4b56-b68a-a19a723ae4a6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:35.757060 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4446769-d027-4b56-b68a-a19a723ae4a6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:35.757488 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d4446769-d027-4b56-b68a-a19a723ae4a6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:35.815890 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d4446769-d027-4b56-b68a-a19a723ae4a6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:35.824481 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d4446769-d027-4b56-b68a-a19a723ae4a6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.080013 Apr 12 15:19:35.825043 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 797/1569] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:35 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:36.844294 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-48716d4a-74c0-447c-be32-8781e01a01a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:36.844856 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-48716d4a-74c0-447c-be32-8781e01a01a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:36.853817 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-48716d4a-74c0-447c-be32-8781e01a01a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:36.854267 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-48716d4a-74c0-447c-be32-8781e01a01a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:36.855029 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-48716d4a-74c0-447c-be32-8781e01a01a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:36.855460 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-48716d4a-74c0-447c-be32-8781e01a01a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:36.914481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-48716d4a-74c0-447c-be32-8781e01a01a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:36.922157 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-48716d4a-74c0-447c-be32-8781e01a01a3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081823 Apr 12 15:19:36.922720 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 773/1570] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:36 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:37.939916 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-81b42b68-27f8-4ad3-829a-6cd4286cab12 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:37.940598 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-81b42b68-27f8-4ad3-829a-6cd4286cab12 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:37.947640 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81b42b68-27f8-4ad3-829a-6cd4286cab12 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:37.948090 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81b42b68-27f8-4ad3-829a-6cd4286cab12 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:37.948841 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81b42b68-27f8-4ad3-829a-6cd4286cab12 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:37.949264 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-81b42b68-27f8-4ad3-829a-6cd4286cab12 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:38.007837 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-81b42b68-27f8-4ad3-829a-6cd4286cab12 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:38.015391 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-81b42b68-27f8-4ad3-829a-6cd4286cab12 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079518 Apr 12 15:19:38.015941 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 798/1571] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:37 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:39.032150 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-e889bcc1-44d0-42ab-92ea-45aeeddabf32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:39.032789 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-e889bcc1-44d0-42ab-92ea-45aeeddabf32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:39.039928 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e889bcc1-44d0-42ab-92ea-45aeeddabf32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:39.040373 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e889bcc1-44d0-42ab-92ea-45aeeddabf32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:39.041150 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e889bcc1-44d0-42ab-92ea-45aeeddabf32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:39.041566 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-e889bcc1-44d0-42ab-92ea-45aeeddabf32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:39.102655 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-e889bcc1-44d0-42ab-92ea-45aeeddabf32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:39.110431 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-e889bcc1-44d0-42ab-92ea-45aeeddabf32 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082214 Apr 12 15:19:39.110989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 774/1572] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:39 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:40.127325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-20d9451a-93c2-4598-8726-2e4f6f57d33b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:40.127990 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-20d9451a-93c2-4598-8726-2e4f6f57d33b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:40.134398 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-20d9451a-93c2-4598-8726-2e4f6f57d33b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:40.134838 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-20d9451a-93c2-4598-8726-2e4f6f57d33b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:40.135589 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-20d9451a-93c2-4598-8726-2e4f6f57d33b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:40.136012 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-20d9451a-93c2-4598-8726-2e4f6f57d33b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:40.203975 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-20d9451a-93c2-4598-8726-2e4f6f57d33b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:40.212407 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-20d9451a-93c2-4598-8726-2e4f6f57d33b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.088923 Apr 12 15:19:40.212977 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 799/1573] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:40 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:41.230590 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4e9f72cc-a323-470b-8f20-ec432769427f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:41.231200 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4e9f72cc-a323-470b-8f20-ec432769427f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:41.237884 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e9f72cc-a323-470b-8f20-ec432769427f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:41.238332 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e9f72cc-a323-470b-8f20-ec432769427f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:41.239101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e9f72cc-a323-470b-8f20-ec432769427f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:41.239531 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4e9f72cc-a323-470b-8f20-ec432769427f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:41.311428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4e9f72cc-a323-470b-8f20-ec432769427f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:41.320717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4e9f72cc-a323-470b-8f20-ec432769427f tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.094013 Apr 12 15:19:41.321288 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 775/1574] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:41 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:42.337538 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-0260d176-f05f-4fa6-8d53-cbc319ff1368 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:42.338180 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-0260d176-f05f-4fa6-8d53-cbc319ff1368 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:42.344424 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0260d176-f05f-4fa6-8d53-cbc319ff1368 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:42.344867 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0260d176-f05f-4fa6-8d53-cbc319ff1368 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:42.345621 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0260d176-f05f-4fa6-8d53-cbc319ff1368 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:42.346716 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-0260d176-f05f-4fa6-8d53-cbc319ff1368 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:42.404968 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-0260d176-f05f-4fa6-8d53-cbc319ff1368 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:42.413367 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-0260d176-f05f-4fa6-8d53-cbc319ff1368 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079673 Apr 12 15:19:42.413961 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 800/1575] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:42 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:43.430727 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-75dea21d-6aac-4d15-b916-4a297979956b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:43.431341 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-75dea21d-6aac-4d15-b916-4a297979956b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:43.437546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75dea21d-6aac-4d15-b916-4a297979956b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:43.438015 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75dea21d-6aac-4d15-b916-4a297979956b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:43.438774 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75dea21d-6aac-4d15-b916-4a297979956b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:43.439205 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-75dea21d-6aac-4d15-b916-4a297979956b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:43.660922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-75dea21d-6aac-4d15-b916-4a297979956b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:43.668748 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-75dea21d-6aac-4d15-b916-4a297979956b tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.241842 Apr 12 15:19:43.669316 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 776/1576] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:43 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:44.686438 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-763f7e6b-64ac-414f-a5a3-7ec83b4e0e95 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:44.686987 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-763f7e6b-64ac-414f-a5a3-7ec83b4e0e95 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:44.693363 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-763f7e6b-64ac-414f-a5a3-7ec83b4e0e95 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:44.693843 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-763f7e6b-64ac-414f-a5a3-7ec83b4e0e95 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:44.694601 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-763f7e6b-64ac-414f-a5a3-7ec83b4e0e95 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:44.695030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-763f7e6b-64ac-414f-a5a3-7ec83b4e0e95 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:44.753599 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-763f7e6b-64ac-414f-a5a3-7ec83b4e0e95 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:44.761473 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-763f7e6b-64ac-414f-a5a3-7ec83b4e0e95 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.078949 Apr 12 15:19:44.762068 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 801/1577] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:44 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:45.778568 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-1d6e0bc3-f127-4bcc-8124-12be1625f7bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:45.779207 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-1d6e0bc3-f127-4bcc-8124-12be1625f7bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:45.786638 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1d6e0bc3-f127-4bcc-8124-12be1625f7bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:45.787084 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1d6e0bc3-f127-4bcc-8124-12be1625f7bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:45.787877 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1d6e0bc3-f127-4bcc-8124-12be1625f7bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:45.788308 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-1d6e0bc3-f127-4bcc-8124-12be1625f7bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:45.846668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-1d6e0bc3-f127-4bcc-8124-12be1625f7bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:45.855714 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-1d6e0bc3-f127-4bcc-8124-12be1625f7bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.080939 Apr 12 15:19:45.856273 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 777/1578] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:45 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:46.872906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6aa7421e-532a-4312-9ecd-1152d44a0346 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:46.873490 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6aa7421e-532a-4312-9ecd-1152d44a0346 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:46.880378 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6aa7421e-532a-4312-9ecd-1152d44a0346 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:46.880821 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6aa7421e-532a-4312-9ecd-1152d44a0346 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:46.883718 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6aa7421e-532a-4312-9ecd-1152d44a0346 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:46.883718 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6aa7421e-532a-4312-9ecd-1152d44a0346 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:46.951065 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6aa7421e-532a-4312-9ecd-1152d44a0346 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:46.959644 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6aa7421e-532a-4312-9ecd-1152d44a0346 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.090626 Apr 12 15:19:46.960206 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 802/1579] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:46 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:47.977090 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-816dd6ba-38f7-43ca-a5a7-97d27a44605c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:47.977673 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-816dd6ba-38f7-43ca-a5a7-97d27a44605c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:47.983862 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-816dd6ba-38f7-43ca-a5a7-97d27a44605c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:47.984303 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-816dd6ba-38f7-43ca-a5a7-97d27a44605c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:47.985051 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-816dd6ba-38f7-43ca-a5a7-97d27a44605c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:47.985476 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-816dd6ba-38f7-43ca-a5a7-97d27a44605c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:48.046232 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-816dd6ba-38f7-43ca-a5a7-97d27a44605c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:48.054194 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-816dd6ba-38f7-43ca-a5a7-97d27a44605c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081015 Apr 12 15:19:48.054755 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 778/1580] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:47 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:49.071643 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6f96e81b-c215-478c-87c2-67783e249f21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:49.072246 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6f96e81b-c215-478c-87c2-67783e249f21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:49.078574 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6f96e81b-c215-478c-87c2-67783e249f21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:49.079034 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6f96e81b-c215-478c-87c2-67783e249f21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:49.079795 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6f96e81b-c215-478c-87c2-67783e249f21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:49.080821 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6f96e81b-c215-478c-87c2-67783e249f21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:49.139901 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6f96e81b-c215-478c-87c2-67783e249f21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:49.149180 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6f96e81b-c215-478c-87c2-67783e249f21 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081369 Apr 12 15:19:49.149748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 803/1581] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:49 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:50.166631 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-cee99015-fb16-4bc1-928c-9670f92393ba tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:50.167252 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-cee99015-fb16-4bc1-928c-9670f92393ba tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:50.173014 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cee99015-fb16-4bc1-928c-9670f92393ba tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:50.173453 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cee99015-fb16-4bc1-928c-9670f92393ba tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:50.174950 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cee99015-fb16-4bc1-928c-9670f92393ba tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:50.175382 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-cee99015-fb16-4bc1-928c-9670f92393ba tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:50.233621 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-cee99015-fb16-4bc1-928c-9670f92393ba tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:50.241353 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-cee99015-fb16-4bc1-928c-9670f92393ba tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.078716 Apr 12 15:19:50.241934 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 779/1582] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:50 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:51.257460 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-f306d587-77c1-4ac4-8acc-80c107d2c928 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:51.258119 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-f306d587-77c1-4ac4-8acc-80c107d2c928 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:51.264030 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f306d587-77c1-4ac4-8acc-80c107d2c928 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:51.264478 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f306d587-77c1-4ac4-8acc-80c107d2c928 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:51.265232 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f306d587-77c1-4ac4-8acc-80c107d2c928 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:51.265687 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-f306d587-77c1-4ac4-8acc-80c107d2c928 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:51.324196 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-f306d587-77c1-4ac4-8acc-80c107d2c928 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:51.333481 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-f306d587-77c1-4ac4-8acc-80c107d2c928 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079656 Apr 12 15:19:51.334096 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 804/1583] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:51 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:52.363853 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-ef7add65-d328-4ff4-bf82-8b8e9ddae039 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:52.364444 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-ef7add65-d328-4ff4-bf82-8b8e9ddae039 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:52.370647 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ef7add65-d328-4ff4-bf82-8b8e9ddae039 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:52.371089 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ef7add65-d328-4ff4-bf82-8b8e9ddae039 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:52.371848 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ef7add65-d328-4ff4-bf82-8b8e9ddae039 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:52.372272 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-ef7add65-d328-4ff4-bf82-8b8e9ddae039 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:52.433756 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-ef7add65-d328-4ff4-bf82-8b8e9ddae039 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:52.442540 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-ef7add65-d328-4ff4-bf82-8b8e9ddae039 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.083573 Apr 12 15:19:52.443094 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 780/1584] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:52 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:53.460211 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d1799ce3-d00e-49a3-a8e2-d7c355d030bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:53.460812 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d1799ce3-d00e-49a3-a8e2-d7c355d030bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:53.467101 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d1799ce3-d00e-49a3-a8e2-d7c355d030bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:53.467548 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d1799ce3-d00e-49a3-a8e2-d7c355d030bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:53.468315 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d1799ce3-d00e-49a3-a8e2-d7c355d030bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:53.468748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d1799ce3-d00e-49a3-a8e2-d7c355d030bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:53.536131 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d1799ce3-d00e-49a3-a8e2-d7c355d030bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:53.536855 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d1799ce3-d00e-49a3-a8e2-d7c355d030bf tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.080995 Apr 12 15:19:53.537068 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 805/1585] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:53 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:54.553654 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c9bfb993-05fb-4e40-963f-ae74ee0106c3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:54.554324 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c9bfb993-05fb-4e40-963f-ae74ee0106c3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:54.560662 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9bfb993-05fb-4e40-963f-ae74ee0106c3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:54.561111 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9bfb993-05fb-4e40-963f-ae74ee0106c3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:54.561910 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9bfb993-05fb-4e40-963f-ae74ee0106c3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:54.562346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c9bfb993-05fb-4e40-963f-ae74ee0106c3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:54.621220 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c9bfb993-05fb-4e40-963f-ae74ee0106c3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:54.629059 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c9bfb993-05fb-4e40-963f-ae74ee0106c3 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079275 Apr 12 15:19:54.629654 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 781/1586] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:54 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:55.646444 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-7502b402-5e29-4ca2-8816-a11eb649315a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:55.647057 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-7502b402-5e29-4ca2-8816-a11eb649315a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:55.653325 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7502b402-5e29-4ca2-8816-a11eb649315a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:55.653803 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7502b402-5e29-4ca2-8816-a11eb649315a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:55.654565 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7502b402-5e29-4ca2-8816-a11eb649315a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:55.654998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-7502b402-5e29-4ca2-8816-a11eb649315a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:55.714051 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-7502b402-5e29-4ca2-8816-a11eb649315a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:55.721945 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-7502b402-5e29-4ca2-8816-a11eb649315a tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079915 Apr 12 15:19:55.722496 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 806/1587] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:55 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:56.738792 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d2e54c15-3fdf-456f-ae57-47fb12af738d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:56.739424 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d2e54c15-3fdf-456f-ae57-47fb12af738d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:56.745654 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d2e54c15-3fdf-456f-ae57-47fb12af738d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:56.746101 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d2e54c15-3fdf-456f-ae57-47fb12af738d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:56.746857 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d2e54c15-3fdf-456f-ae57-47fb12af738d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:56.747281 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d2e54c15-3fdf-456f-ae57-47fb12af738d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:56.809302 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d2e54c15-3fdf-456f-ae57-47fb12af738d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:56.817044 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d2e54c15-3fdf-456f-ae57-47fb12af738d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082249 Apr 12 15:19:56.817582 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 782/1588] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:56 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:57.834527 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-52912eb8-5aa7-45d0-b8c1-9734c416eeda tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:57.835122 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-52912eb8-5aa7-45d0-b8c1-9734c416eeda tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:57.841382 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52912eb8-5aa7-45d0-b8c1-9734c416eeda tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:57.841864 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52912eb8-5aa7-45d0-b8c1-9734c416eeda tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:57.842635 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52912eb8-5aa7-45d0-b8c1-9734c416eeda tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:57.843068 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-52912eb8-5aa7-45d0-b8c1-9734c416eeda tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:57.901603 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-52912eb8-5aa7-45d0-b8c1-9734c416eeda tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:57.909737 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-52912eb8-5aa7-45d0-b8c1-9734c416eeda tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079661 Apr 12 15:19:57.910295 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 807/1589] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:57 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:19:58.926619 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d9c0353d-161f-471d-af9d-b97e554eac00 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:19:58.927177 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d9c0353d-161f-471d-af9d-b97e554eac00 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:19:58.933364 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d9c0353d-161f-471d-af9d-b97e554eac00 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:58.933847 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d9c0353d-161f-471d-af9d-b97e554eac00 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:58.934604 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d9c0353d-161f-471d-af9d-b97e554eac00 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:19:58.935030 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d9c0353d-161f-471d-af9d-b97e554eac00 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:19:58.993746 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d9c0353d-161f-471d-af9d-b97e554eac00 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:19:59.001303 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d9c0353d-161f-471d-af9d-b97e554eac00 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.078655 Apr 12 15:19:59.001912 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 783/1590] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:19:58 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:00.018817 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-73ff635c-ff8c-47f8-bff1-756138453bae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:00.019492 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-73ff635c-ff8c-47f8-bff1-756138453bae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:00.030053 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73ff635c-ff8c-47f8-bff1-756138453bae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:00.030470 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73ff635c-ff8c-47f8-bff1-756138453bae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:00.031409 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73ff635c-ff8c-47f8-bff1-756138453bae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:00.031665 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-73ff635c-ff8c-47f8-bff1-756138453bae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:00.093194 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-73ff635c-ff8c-47f8-bff1-756138453bae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:00.101799 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-73ff635c-ff8c-47f8-bff1-756138453bae tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.086933 Apr 12 15:20:00.102396 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 808/1591] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:00 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:01.119284 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b5876ff8-acd9-4a6d-be39-8b6a1ca211e9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:01.119911 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b5876ff8-acd9-4a6d-be39-8b6a1ca211e9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:01.126111 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b5876ff8-acd9-4a6d-be39-8b6a1ca211e9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:01.126553 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b5876ff8-acd9-4a6d-be39-8b6a1ca211e9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:01.127579 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b5876ff8-acd9-4a6d-be39-8b6a1ca211e9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:01.128004 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b5876ff8-acd9-4a6d-be39-8b6a1ca211e9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:01.190936 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b5876ff8-acd9-4a6d-be39-8b6a1ca211e9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:01.198727 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b5876ff8-acd9-4a6d-be39-8b6a1ca211e9 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.083319 Apr 12 15:20:01.199272 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 784/1592] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:01 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:02.215822 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b07c0572-fd9f-4d4e-848f-77b6e8e60839 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:02.216435 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b07c0572-fd9f-4d4e-848f-77b6e8e60839 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:02.223431 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b07c0572-fd9f-4d4e-848f-77b6e8e60839 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:02.223764 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b07c0572-fd9f-4d4e-848f-77b6e8e60839 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:02.224532 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b07c0572-fd9f-4d4e-848f-77b6e8e60839 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:02.224969 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b07c0572-fd9f-4d4e-848f-77b6e8e60839 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:02.285100 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b07c0572-fd9f-4d4e-848f-77b6e8e60839 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:02.293202 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b07c0572-fd9f-4d4e-848f-77b6e8e60839 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081216 Apr 12 15:20:02.293785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 809/1593] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:02 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:03.310717 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-4df16378-eedc-4034-9ede-d1a98077ee1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:03.311325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-4df16378-eedc-4034-9ede-d1a98077ee1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:03.318551 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4df16378-eedc-4034-9ede-d1a98077ee1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:03.318999 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4df16378-eedc-4034-9ede-d1a98077ee1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:03.319786 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4df16378-eedc-4034-9ede-d1a98077ee1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:03.320213 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-4df16378-eedc-4034-9ede-d1a98077ee1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:03.378732 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-4df16378-eedc-4034-9ede-d1a98077ee1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:03.386315 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-4df16378-eedc-4034-9ede-d1a98077ee1c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079489 Apr 12 15:20:03.386864 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 785/1594] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:03 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:04.403809 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-6d2fc538-060d-4a5f-84dc-76145f7efee1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:04.404414 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-6d2fc538-060d-4a5f-84dc-76145f7efee1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:04.412585 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d2fc538-060d-4a5f-84dc-76145f7efee1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:04.413032 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d2fc538-060d-4a5f-84dc-76145f7efee1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:04.413822 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d2fc538-060d-4a5f-84dc-76145f7efee1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:04.414252 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-6d2fc538-060d-4a5f-84dc-76145f7efee1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:04.473883 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-6d2fc538-060d-4a5f-84dc-76145f7efee1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:04.481676 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-6d2fc538-060d-4a5f-84dc-76145f7efee1 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081686 Apr 12 15:20:04.482235 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 810/1595] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:04 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:05.498624 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-b78284e7-503c-4467-aec6-de86a98d2526 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:05.499262 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-b78284e7-503c-4467-aec6-de86a98d2526 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:05.507906 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b78284e7-503c-4467-aec6-de86a98d2526 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:05.508547 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b78284e7-503c-4467-aec6-de86a98d2526 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:05.511063 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b78284e7-503c-4467-aec6-de86a98d2526 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:05.511567 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-b78284e7-503c-4467-aec6-de86a98d2526 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:05.584668 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-b78284e7-503c-4467-aec6-de86a98d2526 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:05.593512 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-b78284e7-503c-4467-aec6-de86a98d2526 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.098533 Apr 12 15:20:05.594037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 786/1596] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:05 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:06.611748 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9a455af6-5fd1-427c-b91b-f76e0c68a5d6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:06.612383 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9a455af6-5fd1-427c-b91b-f76e0c68a5d6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:06.618658 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a455af6-5fd1-427c-b91b-f76e0c68a5d6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:06.619106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a455af6-5fd1-427c-b91b-f76e0c68a5d6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:06.619865 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a455af6-5fd1-427c-b91b-f76e0c68a5d6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:06.620294 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9a455af6-5fd1-427c-b91b-f76e0c68a5d6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:06.679381 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9a455af6-5fd1-427c-b91b-f76e0c68a5d6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:06.687160 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9a455af6-5fd1-427c-b91b-f76e0c68a5d6 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079365 Apr 12 15:20:06.687721 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 811/1597] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:06 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:07.704916 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-88979f84-a2a3-49ab-b95b-cc4ffef0550d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:07.705481 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-88979f84-a2a3-49ab-b95b-cc4ffef0550d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:07.711428 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88979f84-a2a3-49ab-b95b-cc4ffef0550d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:07.711881 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88979f84-a2a3-49ab-b95b-cc4ffef0550d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:07.712680 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88979f84-a2a3-49ab-b95b-cc4ffef0550d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:07.713110 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-88979f84-a2a3-49ab-b95b-cc4ffef0550d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:07.771437 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-88979f84-a2a3-49ab-b95b-cc4ffef0550d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:07.778949 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-88979f84-a2a3-49ab-b95b-cc4ffef0550d tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.078339 Apr 12 15:20:07.779505 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 787/1598] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:07 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:08.796593 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-4c4aadec-409f-4740-9f20-4c82e8a8b51e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:08.797201 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-4c4aadec-409f-4740-9f20-4c82e8a8b51e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:08.803660 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4c4aadec-409f-4740-9f20-4c82e8a8b51e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:08.804106 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4c4aadec-409f-4740-9f20-4c82e8a8b51e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:08.804871 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4c4aadec-409f-4740-9f20-4c82e8a8b51e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:08.805302 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-4c4aadec-409f-4740-9f20-4c82e8a8b51e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:08.863597 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-4c4aadec-409f-4740-9f20-4c82e8a8b51e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:08.871250 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-4c4aadec-409f-4740-9f20-4c82e8a8b51e tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.078532 Apr 12 15:20:08.871798 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 812/1599] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:08 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:09.888269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-d44501e7-7fc2-4be1-b7e1-814f1beb4be7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:09.888823 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-d44501e7-7fc2-4be1-b7e1-814f1beb4be7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:09.895397 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d44501e7-7fc2-4be1-b7e1-814f1beb4be7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:09.895846 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d44501e7-7fc2-4be1-b7e1-814f1beb4be7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:09.896614 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d44501e7-7fc2-4be1-b7e1-814f1beb4be7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:09.897045 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-d44501e7-7fc2-4be1-b7e1-814f1beb4be7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:09.961021 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-d44501e7-7fc2-4be1-b7e1-814f1beb4be7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:09.968641 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-d44501e7-7fc2-4be1-b7e1-814f1beb4be7 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.084309 Apr 12 15:20:09.969190 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 788/1600] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:09 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:10.989080 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-b8526ec0-5cd4-41cb-8801-3bac41e51878 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:10.989680 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-b8526ec0-5cd4-41cb-8801-3bac41e51878 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:10.996937 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8526ec0-5cd4-41cb-8801-3bac41e51878 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:10.997382 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8526ec0-5cd4-41cb-8801-3bac41e51878 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:10.998176 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8526ec0-5cd4-41cb-8801-3bac41e51878 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:10.998609 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-b8526ec0-5cd4-41cb-8801-3bac41e51878 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:11.064588 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-b8526ec0-5cd4-41cb-8801-3bac41e51878 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:11.072845 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-b8526ec0-5cd4-41cb-8801-3bac41e51878 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.089541 Apr 12 15:20:11.073422 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 813/1601] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:10 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:12.090599 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-33b4807e-2d47-4a96-a928-1a93fe442a65 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:12.091198 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-33b4807e-2d47-4a96-a928-1a93fe442a65 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:12.098165 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-33b4807e-2d47-4a96-a928-1a93fe442a65 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:12.098603 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-33b4807e-2d47-4a96-a928-1a93fe442a65 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:12.099362 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-33b4807e-2d47-4a96-a928-1a93fe442a65 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:12.099789 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-33b4807e-2d47-4a96-a928-1a93fe442a65 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:12.157083 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-33b4807e-2d47-4a96-a928-1a93fe442a65 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:12.165788 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-33b4807e-2d47-4a96-a928-1a93fe442a65 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079025 Apr 12 15:20:12.166346 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 789/1602] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:12 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:13.184195 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-c6a19f24-8bb8-4a24-b55e-829aa121f2ce tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:13.184801 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-c6a19f24-8bb8-4a24-b55e-829aa121f2ce tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:13.191275 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6a19f24-8bb8-4a24-b55e-829aa121f2ce tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:13.191721 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6a19f24-8bb8-4a24-b55e-829aa121f2ce tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:13.192478 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6a19f24-8bb8-4a24-b55e-829aa121f2ce tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:13.192906 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-c6a19f24-8bb8-4a24-b55e-829aa121f2ce tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:13.254497 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-c6a19f24-8bb8-4a24-b55e-829aa121f2ce tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:13.262285 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-c6a19f24-8bb8-4a24-b55e-829aa121f2ce tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.081954 Apr 12 15:20:13.262849 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 814/1603] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:13 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:14.280096 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-32abbe84-333a-49fb-a109-154ff35f13eb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:14.280685 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-32abbe84-333a-49fb-a109-154ff35f13eb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:14.287385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32abbe84-333a-49fb-a109-154ff35f13eb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:14.287773 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32abbe84-333a-49fb-a109-154ff35f13eb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:14.288538 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32abbe84-333a-49fb-a109-154ff35f13eb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:14.288970 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-32abbe84-333a-49fb-a109-154ff35f13eb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:14.351021 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-32abbe84-333a-49fb-a109-154ff35f13eb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:14.358614 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-32abbe84-333a-49fb-a109-154ff35f13eb tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.082401 Apr 12 15:20:14.359176 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 790/1604] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:14 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:15.375772 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-8b6add58-2020-4b97-bbe5-afac1644cb4c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:15.376810 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-8b6add58-2020-4b97-bbe5-afac1644cb4c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:15.382794 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b6add58-2020-4b97-bbe5-afac1644cb4c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:15.383247 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b6add58-2020-4b97-bbe5-afac1644cb4c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:15.384015 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b6add58-2020-4b97-bbe5-afac1644cb4c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:15.384450 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-8b6add58-2020-4b97-bbe5-afac1644cb4c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:15.442313 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-8b6add58-2020-4b97-bbe5-afac1644cb4c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:15.449964 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-8b6add58-2020-4b97-bbe5-afac1644cb4c tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.078059 Apr 12 15:20:15.450520 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 815/1605] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:15 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:16.467423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-c270ae56-3862-4642-a65f-6559f9e04dc8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:16.468011 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-c270ae56-3862-4642-a65f-6559f9e04dc8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:16.474762 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c270ae56-3862-4642-a65f-6559f9e04dc8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:16.475228 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c270ae56-3862-4642-a65f-6559f9e04dc8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:16.475989 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c270ae56-3862-4642-a65f-6559f9e04dc8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:16.476413 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-c270ae56-3862-4642-a65f-6559f9e04dc8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:16.535673 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-c270ae56-3862-4642-a65f-6559f9e04dc8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:16.543496 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-c270ae56-3862-4642-a65f-6559f9e04dc8 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079940 Apr 12 15:20:16.544055 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 791/1606] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:16 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:17.560475 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-9cbb78f3-0a8d-495c-b340-5edbb29a0950 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:17.561126 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-9cbb78f3-0a8d-495c-b340-5edbb29a0950 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:17.568167 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9cbb78f3-0a8d-495c-b340-5edbb29a0950 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:17.568615 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9cbb78f3-0a8d-495c-b340-5edbb29a0950 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:17.569415 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9cbb78f3-0a8d-495c-b340-5edbb29a0950 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:17.569942 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-9cbb78f3-0a8d-495c-b340-5edbb29a0950 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:17.632143 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-9cbb78f3-0a8d-495c-b340-5edbb29a0950 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:17.639921 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-9cbb78f3-0a8d-495c-b340-5edbb29a0950 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.083487 Apr 12 15:20:17.640486 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 816/1607] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:17 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:18.659015 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-6255448f-2b6b-433a-ae2e-f7ecf874ec76 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:18.659624 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-6255448f-2b6b-433a-ae2e-f7ecf874ec76 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:18.665733 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6255448f-2b6b-433a-ae2e-f7ecf874ec76 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:18.666174 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6255448f-2b6b-433a-ae2e-f7ecf874ec76 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:18.666928 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6255448f-2b6b-433a-ae2e-f7ecf874ec76 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:18.667360 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-6255448f-2b6b-433a-ae2e-f7ecf874ec76 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:18.729275 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.policy [None req-6255448f-2b6b-433a-ae2e-f7ecf874ec76 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124198) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:18.737703 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-6255448f-2b6b-433a-ae2e-f7ecf874ec76 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.084018 Apr 12 15:20:18.738366 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 792/1608] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:18 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:19.755071 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-d0e28784-7119-4717-a98e-b27121c51598 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:20:19.755703 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-d0e28784-7119-4717-a98e-b27121c51598 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] [instance: b39507a5-c1c1-4c1f-b6f2-bc75f4807e80] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:20:19.761992 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0e28784-7119-4717-a98e-b27121c51598 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:19.762469 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0e28784-7119-4717-a98e-b27121c51598 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:19.763233 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0e28784-7119-4717-a98e-b27121c51598 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:20:19.763720 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-d0e28784-7119-4717-a98e-b27121c51598 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:20:19.822243 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-d0e28784-7119-4717-a98e-b27121c51598 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f5de43637247db911592127a48ff53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd534a0fcf985433abc053d9e9543281f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:20:19.830534 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-d0e28784-7119-4717-a98e-b27121c51598 tempest-VolumesSnapshotTestJSON-1616532945 tempest-VolumesSnapshotTestJSON-1616532945-project] 10.222.0.64 "GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80" status: 200 len: 1350 microversion: 2.1 time: 0.079379 Apr 12 15:20:19.831095 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 817/1609] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:20:19 2022] GET /compute/v2.1/servers/b39507a5-c1c1-4c1f-b6f2-bc75f4807e80 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:20:57.198997 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:20:57.199631 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:20:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:21:05.640374 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:21:05.641088 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:21:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:21:07.055158 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:21:07.055751 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:21:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:21:19.720845 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:21:19.721345 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:21:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:21:19.766856 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:21:19.767344 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:21:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:21:34.691987 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:21:34.692591 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:21:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:24:17.207785 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:24:17.208722 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:24:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:24:25.647983 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:24:25.648609 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:24:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:24:27.062765 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:24:27.063325 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:24:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:24:39.729132 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:24:39.729964 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:24:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:24:39.774993 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:24:39.775511 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:24:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:24:54.699761 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:24:54.700308 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:24:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:26:55.847997 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bbc5f29-79e1-46fa-bc8e-3c2352526a7e] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 15:26:55.851779 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-3d89e6cf-2981-4dd4-b53a-d0734e2b6f16 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:26:55.852269 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3d89e6cf-2981-4dd4-b53a-d0734e2b6f16 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:26:55.858248 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d89e6cf-2981-4dd4-b53a-d0734e2b6f16 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:26:55.858836 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d89e6cf-2981-4dd4-b53a-d0734e2b6f16 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:26:55.859679 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d89e6cf-2981-4dd4-b53a-d0734e2b6f16 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:26:55.860116 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-3d89e6cf-2981-4dd4-b53a-d0734e2b6f16 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:26:55.883495 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-3d89e6cf-2981-4dd4-b53a-d0734e2b6f16 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Going to try to terminate instance {{(pid=124198) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 15:26:56.144625 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-3d89e6cf-2981-4dd4-b53a-d0734e2b6f16 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "DELETE /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 204 len: 0 microversion: 2.1 time: 0.298835 Apr 12 15:26:56.145423 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 793/1610] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Apr 12 15:26:55 2022] DELETE /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 15:26:56.152236 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: ERROR oslo.messaging._drivers.impl_rabbit [-] [090fb861-6bc9-4f43-ab8e-93bedc0e9663] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 15:26:56.156496 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-fca46a57-d9f5-4cf6-bdcc-a1eee469a92c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:26:56.157098 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-fca46a57-d9f5-4cf6-bdcc-a1eee469a92c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:26:56.163420 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fca46a57-d9f5-4cf6-bdcc-a1eee469a92c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:26:56.163859 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fca46a57-d9f5-4cf6-bdcc-a1eee469a92c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:26:56.164608 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fca46a57-d9f5-4cf6-bdcc-a1eee469a92c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:26:56.165113 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-fca46a57-d9f5-4cf6-bdcc-a1eee469a92c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:26:56.408734 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-fca46a57-d9f5-4cf6-bdcc-a1eee469a92c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:26:56.415994 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-fca46a57-d9f5-4cf6-bdcc-a1eee469a92c tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1556 microversion: 2.1 time: 0.266387 Apr 12 15:26:56.416582 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 818/1611] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:26:56 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1556 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:26:57.128978 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bbc5f29-79e1-46fa-bc8e-3c2352526a7e] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39384. Apr 12 15:26:57.184298 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [req-bcb8e491-0170-47f5-8913-ea98c9900cfa req-0545194b-b3ba-40fc-8dd7-7d8537f7d429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40087dd0-4e35-4fa7-a289-68d4db17ee5f", "name": "network-vif-deleted", "tag": "6f814532-934c-4416-b3a5-eb58a7905405"}]} {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:26:57.193610 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-bcb8e491-0170-47f5-8913-ea98c9900cfa req-0545194b-b3ba-40fc-8dd7-7d8537f7d429 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:26:57.194068 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [req-bcb8e491-0170-47f5-8913-ea98c9900cfa req-0545194b-b3ba-40fc-8dd7-7d8537f7d429 service nova] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:26:57.204333 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.compute.server_external_events [req-bcb8e491-0170-47f5-8913-ea98c9900cfa req-0545194b-b3ba-40fc-8dd7-7d8537f7d429 service nova] Creating event network-vif-deleted:6f814532-934c-4416-b3a5-eb58a7905405 for instance 40087dd0-4e35-4fa7-a289-68d4db17ee5f on hv-cinder-83752 Apr 12 15:26:57.209548 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [req-bcb8e491-0170-47f5-8913-ea98c9900cfa req-0545194b-b3ba-40fc-8dd7-7d8537f7d429 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093196 Apr 12 15:26:57.210239 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 794/1612] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Apr 12 15:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 15:26:57.433442 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-e5f66d87-f83e-45a7-8c70-eeeda391559a tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:26:57.435547 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.compute.api [None req-e5f66d87-f83e-45a7-8c70-eeeda391559a tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124199) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:26:57.441728 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5f66d87-f83e-45a7-8c70-eeeda391559a tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:26:57.442181 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5f66d87-f83e-45a7-8c70-eeeda391559a tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:26:57.442955 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5f66d87-f83e-45a7-8c70-eeeda391559a tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:26:57.443385 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG oslo_concurrency.lockutils [None req-e5f66d87-f83e-45a7-8c70-eeeda391559a tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:26:57.460910 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] [090fb861-6bc9-4f43-ab8e-93bedc0e9663] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39388. Apr 12 15:26:57.518828 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.policy [None req-e5f66d87-f83e-45a7-8c70-eeeda391559a tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab4730f1d2140ca8ccc2d5227e7a97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c6845b3d9d43428aee79de0f571835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124199) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 15:26:57.526996 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-e5f66d87-f83e-45a7-8c70-eeeda391559a tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 200 len: 1344 microversion: 2.1 time: 0.097322 Apr 12 15:26:57.527559 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 819/1613] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:26:57 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 1344 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:26:58.544757 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9f3c3190-fbf3-4e72-97cd-bd9e11942724 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '>' {{(pid=124198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:26:58.546167 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.compute.api [None req-9f3c3190-fbf3-4e72-97cd-bd9e11942724 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] [instance: 40087dd0-4e35-4fa7-a289-68d4db17ee5f] Fetching instance by UUID {{(pid=124198) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 15:26:58.552671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9f3c3190-fbf3-4e72-97cd-bd9e11942724 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:26:58.553113 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9f3c3190-fbf3-4e72-97cd-bd9e11942724 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:26:58.553893 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9f3c3190-fbf3-4e72-97cd-bd9e11942724 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 15:26:58.554323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG oslo_concurrency.lockutils [None req-9f3c3190-fbf3-4e72-97cd-bd9e11942724 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Lock "801f6a72-d6ac-4cbe-9661-63bd44124606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 15:26:58.567568 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.wsgi [None req-9f3c3190-fbf3-4e72-97cd-bd9e11942724 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] HTTP exception thrown: Instance 40087dd0-4e35-4fa7-a289-68d4db17ee5f could not be found. Apr 12 15:26:58.568143 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: DEBUG nova.api.openstack.wsgi [None req-9f3c3190-fbf3-4e72-97cd-bd9e11942724 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Returning 404 to user: Instance 40087dd0-4e35-4fa7-a289-68d4db17ee5f could not be found. {{(pid=124198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 15:26:58.568974 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO nova.api.openstack.requestlog [None req-9f3c3190-fbf3-4e72-97cd-bd9e11942724 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f" status: 404 len: 111 microversion: 2.1 time: 0.028439 Apr 12 15:26:58.569492 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: [pid: 124198|app: 0|req: 795/1614] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Apr 12 15:26:58 2022] GET /compute/v2.1/servers/40087dd0-4e35-4fa7-a289-68d4db17ee5f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:26:58.578408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: DEBUG nova.api.openstack.wsgi [None req-097262a6-e6c0-4d5d-a04f-20fcd5c69618 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] Calling method '.version_select at 0x7fbd607b2af0>' {{(pid=124199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:26:58.751277 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO nova.api.openstack.requestlog [None req-097262a6-e6c0-4d5d-a04f-20fcd5c69618 tempest-TestMinimumBasicScenario-451847862 tempest-TestMinimumBasicScenario-451847862-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1638317891" status: 202 len: 0 microversion: 2.1 time: 0.177475 Apr 12 15:26:58.751853 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: [pid: 124199|app: 0|req: 820/1615] 10.222.0.64 () {58 vars in 1271 bytes} [Tue Apr 12 15:26:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1638317891 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 15:27:37.216911 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:27:37.217558 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:27:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:27:47.070859 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:27:47.071476 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:27:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:27:59.737383 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:27:59.737972 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:27:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:27:59.783052 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:27:59.783531 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:27:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:29:25.658808 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 15:29:25.659909 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:29:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:29:54.709909 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:29:54.710594 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:30:57.226635 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:30:57.227284 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:31:07.079138 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:31:07.079755 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:31:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:31:19.745823 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:31:19.746660 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:31:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:31:19.791445 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:31:19.792035 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:31:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:32:45.666998 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:32:45.667750 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:32:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:33:14.718037 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:33:14.718896 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:34:17.234658 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:34:17.235258 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:34:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:34:27.087140 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:34:27.087671 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:34:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:34:39.755922 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:34:39.756546 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:34:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:34:39.799446 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:34:39.799937 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:34:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:36:05.675833 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:36:05.676497 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:36:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:36:34.727964 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:36:34.728802 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:37:37.244408 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:37:37.245012 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:37:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:37:47.096611 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:37:47.097385 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:37:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:37:59.765682 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:37:59.766323 dv-cinder-837524-1-iscsi devstack@n-api.service[124198]: Tue Apr 12 15:37:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 15:37:59.808270 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 15:37:59.808888 dv-cinder-837524-1-iscsi devstack@n-api.service[124199]: Tue Apr 12 15:37:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!